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APPARATUS AND METHOD FOR LIGHT CONTROL IN AN IN-VIVO IMAGING 

DEVICE 



BACKGROUND OF THE INVENTION 

Devices and methods for performing in-vivo imaging of passages or 
cavities within a body are known in the art. Such devices may include, inter alia, 
various endoscopic imaging systems and devices for performing imaging in 

various internal body cavities. 

Reference is now made to Fig. 1 which is a schematic diagram 
illustrating an embodiment of an autonomous in-vivo imaging device. The device 
1 0A typically includes an optical window 21 and an imaging system for obtaining 
images from inside a body cavity or lumen, such as the Gl tract. The imaging 
system includes an illumination unit 23. The illumination unit 23 may include one 
or more discrete light sources 23A, or may include only one light source 23A. 
The one or more light sources 23A may be a white light emitting diode (LED), or 
any other suitable light source, known in the art. The device 10A includes a 
CMOS imaging sensor 24, which acquires the images and an optical system 22 
which focuses the images onto the CMOS imaging sensor 24. The illumination 
unit 23 illuminates the inner portions of the body lumen through an optical 
window 21. Device 10A further includes a transmitter 26 and an antenna 27 for 
transmitting the video signal of the CMOS imaging sensor 24, and one or more 
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such as but not limited to silver oxide batteries, lithium batteries, or other 
electrochemical cells having a high energy density, or the like. The power 
source(s) 25 may provide power to the electrical elements of the device 10A. 

Typically, in the gastrointestinal application, as the device 10A is 
5 transported through the gastrointestinal (Gl) tract, the imager, such as but not 
limited to the multi-pixel CMOS sensor 24 of the device 10A acquires images 
(frames) which are processed and transmitted to an external receiver/recorder 
(not shown) worn by the patient for recording and storage. The recorded data 
may then be downloaded from the receiver/recorder to a computer or workstation 
10 (not shown) for display and analysis. Other systems and methods may also be 
suitable. 

During the movement of the device 10A through the Gl tract, the imager 
may acquire frames at a fixed or at a variable frame acquisition rate. For 
example, the imager (such as, but not limited to the CMOS sensor 24 of Fig. 1) 

15 may acquire images at a fixed rate of two frames per second (2 Hz). However, 
other different frame rates may also be used, depending, inter alia, on the type 
and characteristics of the specific imager or camera or sensor array 
implementation that is used, and on the available transmission bandwidth of the 
transmitter 26. The downloaded images may be displayed by the workstation by 

20 replaying them at a desired frame rate. According to this implementation, the 
expert or physician examining the data may be provided with a movie-like video 
playback, which may enable the physician to review the passage of the dev.ce 

through the Gl tract. 

One of the limitations of electronic imaging sensors is that they may have 

25 a limited dynamic range. The dynamic range of most existing electronic imaging 
sensors Is significantly lower than the dynamic range of the human eye. Thus, 
when the imaged field of view includes both dark and bright parts or imaged 
objects, the limited dynamic range of the imaging sensor may result in 
underexposure of the dark parts of the field of view, or overexposure of the bnght 

30 parts of the field of view, or both. 



P-4257-IL1 



3 



Various methods may be used for increasing the dynamic range of an 
imager. Such methods may inciude changing the amount of light reaching the 
imaging sensor, such as for example by changing the diameter of an iris or 
diaphragm included in the imaging device to increase or decrease the amount of 
light reaching the imaging sensor, methods for changing the exposure time, 
methods for changing the gain of the imager or methods for changing the 
intensity of the illumination. For example, in still cameras, the intensity of the 
flash unit may be changed during the exposure of the film. 

When a series of consecutive frames is imaged such as in video 
cameras, the intensity of illumination of the imaged field of view within the 
currently imaged frame may be modified based on the results of measurement of 
light intensity performed in one or more previous frames. This method is based 
on the assumption that the illumination conditions do not change abruptly from 
one frame to the consecutive frame. 

However, in an in vivo imaging device, for example, for imaging the Gl 
tract, which may operate at low frame rates and which is moved through a body 
lumen (e.g., propelled by the peristaltic movements of the intestinal walls), the 
illumination conditions may vary significantly from one frame to the next frame. 
Therefore, methods of controlling the illumination based on analysis of data or 
measurement results of previous frames may not be always feasible, particularly 
at low frame rates. 

Therefore there is a need for an imaging device that provides more 
accurate illumination, possibly tailored to particular in-vivo illumination 
requirements or environmental conditions. 



SUMMARY OF THE INVENTION 

Some embodiments of the present invention include a device and method 
for operating an in vivo imaging device wherein the illumination produced by the 
device may be varied in intensity and/or duration according to, for example, the 
amount of illumination produced by the device, which is reflected back to the 
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device. In such a manner, the illumination can be controlled and made more 
efficient. 

According to some embodiments of the present invention, a method for 
implementing light control in an in vivo device is provided. Accordingly, the 

5 parameters such as exposure time and/or the gain factor, or other parameters, 
for transmitting the recorded light may be altered. For example, the gain factor 
may be altered as a function of a light saturation level measured at at least one 
interval within the frame exposure period. In such a manner the in vivo device 
can prevent cases of over and under exposure, in addition to helping to ensure 

10 that exposure ceases after full exposure is attained. 

According to some embodiments of the present invention, a method is 
provided for detecting problematic pixels in an imaging device. This method may 
enable defining and/or excluding problematic or non-functional pixels, for 
example based on an initial short exposure that enables a threshold saturation 

15 level to be reached only for problematic pixels. 

According to some embodiments of the present invention, a method is 
provided for determining when an in vivo imaging device has entered a particular 
part of a body. Accordingly, environmental measurement devices may be used to 
detect environmental parameters, such as pH levels and temperature levels etc. 

20 Results recorded from these measurement devices may be used to define areas, 
regions, organs etc. wherein the in vivo device may be or may have been 
located. The device mode may be changed in accordance with the resulting 
definition. 

According to some embodiments of the present invention, a method is 
25 provided for determining when an in vivo imaging device has entered a body, 
using dark frames. For example, when dark frames require substantial gain factor 
to attain full exposure, the device may be defined as being inside a body (a dark 
environment). The device mode may be changed in accordance with the resulting 
definition. 

30 



P-4257-IL1 



5 



BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is herein described, by way of example only, with 
reference to the accompanying drawings, in which like components are 
designated by like reference numerals, it being understood that these drawings 
are given for illustrative purposes only and are not meant to be limiting, wherein: 

Fig. 1 is a schematic diagram illustrating an embodiment of a prior art 
autonomous in-vivo imaging device; 

Fig. 2 is a schematic block diagram illustrating part of an in-vivo imaging 
device having an automatic illumination control system, in accordance with an 
embodiment of the present invention; 

Fig. 3 is a schematic cross-sectional view of part of an in-vivo imaging 
device having an automatic illumination control system and four light sources, in 
accordance with an embodiment of the present invention; 

Fig. 4 is a schematic front view of the device illustrated in Fig. 3; 
Fig. 5 is a schematic diagram illustrating a method of timing of the 
illumination and image acquisition in an in vivo imaging device having a fixed 
illumination duration, according to an embodiment of the invention; 

Fig. 6 is a schematic diagram illustrating one possible configuration for an 
illumination control unit coupled to a light sensing photodiode and to a light 
emitting diode, in accordance with an embodiment of the present invention; 

Fig. 7 is a schematic diagram illustrating the illumination control unit of Fig. 
6 in detail, in accordance with an embodiment of the present invention; 

Fig. 8 is a schematic diagram useful for understanding a method of timing 
of the illumination and image acquisition in an in vivo imaging device having a 
variable controlled illumination duration, according to an embodiment of the 
invention; 

Fig. 9 is a schematic diagram useful for understanding a method of timing 
of the illumination and image acquisition in an in vivo imaging device having a 
variable frame rate and a variable controlled illumination duration according to an 
embodiment of the invention; 
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Fig 10A is a timing diagram schematically illustrating an imaging cycle of 
an in vivo imaging device using an automatic illumination control method, in 
accordance with another embodiment of the present invention; 

Fig. 1 0B is a schematic exemplary graph representing the light intensity as 
a function of time, possible when using a method of automatic illumination 
control, according to an embodiment of the invention, for example as illustrated in 
Fig. 1 0A; 

Fig. 10C is another exemplary schematic graph representing another 
example of the light intensity as a function of time, possible when using a method 
of automatic illumination control, according to an embodiment of the invention, 

illustrated in Fig. 10A; 

Fig. 11 is a schematic diagram illustrating an illumination control unit 
including a plurality of light sensing units for controlling a plurality of light sources, 
in accordance with an embodiment of the present invention; 

Fig. 12 is a schematic diagram illustrating a front view of an autonomous 
imaging device having four light sensing units and four light sources, in 
accordance with an embodiment of the present invention; 

Fig. 13 is a schematic top view illustrating the arrangement of pixels on the 
surface of a CMOS imager usable for illumination control, in accordance with an 
embodiment of the present invention; 

Fig. 14 is a schematic top view of the pixels of a CMOS imager illustrating ■ 
an exemplary distribution of control pixel groups suitable for being used in local 
illumination control in an imaging device, according to an embodiment of the 
invention; 

Fig. 15 is a schematic exemplary graph representing the light saturation as 
a function of pixel output and time, possibly when implementing light control, 
according to an embodiment of the invention; 

Fig. 16A depicts a series of steps of a method according to an 
embodiment of the present invention; 

Fig. 16B depicts a series of steps of a method according to an alternate 

embodiment of the present invention; and 
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Fig. 16C depicts a series of steps of a method according to an additional 
embodiment of the present invention. 



DETAILED DESCRIPTION OF THE INVENTION 

Various aspects of the present invention are described herein. For 
purposes of explanation, specific configurations and details are set forth in order 
to provide a thorough understanding of the present invention. However, it will 
also be apparent to one skilled in the art that the present invention may be 
practiced without the specific details presented herein. Furthermore, well known 
features may be omitted or simplified in order not to obscure the present 
invention. 

Some embodiments of the present invention are based, inter alia, on 
controlling the illumination provided by the in-vivo imaging device based on light 
measurement which is performed within the duration of a single frame acquisition 

time or a part thereof. 

It is noted that while the embodiments of the invention shown hereinbelow 
are adapted for imaging of the gastrointestinal (Gl) tract, the devices and 
methods disclosed herein may be adapted for imaging other body cavities or 
spaces. 

Reference is now made to Fig. 2 which is a schematic block diagram 
illustrating part of an in-vivo imaging device having an automatic illumination 
control system, in accordance with an embodiment of the present Invention. The 
device 30 may be constructed as a swallowable video capsule as disclosed for 
the device 10A of Fig.1 or in U.S. patent 5,604,531 to Iddan et al., or in Co- 
pending PCT Patent Application, Publication no. WO 01/65995 to Glukhovsky et 
al, both hereby incorporated by reference in their entirety. However, the system 
and method of the present invention may be used in conjunction with other in- 
vivo imaging devices. 

The device 30 may include an imaging unit 32 adapted for imaging the Gl 
tract. The imaging unit 32 may include an imaging sensor (not shown in detail). 
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such as but not limited to the CMOS imaging sensor 24 of Fig. 1. However, the 
imaging unit 32 may include any other suitable type of imaging sensor known in 
the art. The imaging unit 32 may also include an optical unit 32A including one or 
more optical elements (not shown), such as one or more lenses (not shown), one 

5 or more composite lens assemblies (not shown), one or more suitable optical 
filters (not shown), or any other suitable optical elements (not shown) adapted for 
focusing an image of the Gl tract on the imaging sensor as is known in the art 
and disclosed hereinabove with respect to the optical unit 22 of Fig. 1 . 

The optical unit 32A may include one or more optical elements (not 

10 shown) which are integrated with the imaging unit 32A, such as for example, a 
lens (not shown) which is attached to, or mounted on, or fabricated on or 
adjacent to the imager light sensitive pixels (not shown) as is known in the art. 

The device 30 may also include a telemetry unit 34 suitably connected to 
the imaging unit 32 for telemetrically transmitting the images acquired by the 

15 imaging unit 32 to an external receiving device (not shown), such as but not 
limited to the receiver/recorder device disclosed in U.S. patent 5,604,531 to 
Iddan et al., or in Co-pending PCT Patent Application, Publication No. WO 
01/65995to Glukhovsky et al. 

The device 30 may also include a controller/processor unit 36 suitably 

20 connected to the imaging unit 32 for controlling the operation of the imaging unit 
32. The controller/processor unit 36 may comprise any suitable type of 
controller, such as but not limited to, an analog controller, a digital controller such 
as, for example, a data processor, a microprocessor, a micro-controller, or a 
digital signal processor (DSP). The controller/processor unit 36 may also 

25 comprise hybrid analog/digital circuits as are known in the art. The controller/ 
processor unit 36 may be suitably connected to the telemetry unit 34 for 
controlling the transmission of image frames by the telemetry unit 34. 

The controller/processor unit 36 may be (optionally) suitably connected to 
the imaging unit 32 for sending control signals thereto. The controller/processor 

30 unit 36 may thus (optionally) control the transmission of image data from the 
imaging unit 32 to the telemetry unit 34. 



V 
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The device 30 may include an illuminating unit 38 for illuminating the Gl 
tract. The illuminating unit 38 may include one or more discrete light sources 
38A, 38B, to 38N or may include only one light source; such light source(s) may 
be, for example, but are not limited to, the light sources 23A of Fig. 1. The light 
source(s) 38A, 38B, to 38N of the illuminating unit 38 may be white light emitting 
diodes, such as the light sources disclosed in co-pending PCT Patent 
Application, Publication No. WO 01/65995 to Glukhovsky et al. However, the 
light source(s) 38A, 38B, 38N of the illuminating unit 38 may also be any other 
suitable light source, known in the art, such as but not limited to incandescent 
lamp(s), flash lamp(s) or gas discharge lamp(s), or any other suitable light 
source(s). 

It is noted that, in accordance with another embodiment of the present 
invention, the in vivo imaging device may include a single light source (not 
shown). 

The device 30 may also include an illumination control unit 40 suitably 
connected to the light sources 38A, 38B, to 38N of the illuminating unit 38 for 
controlling the energizing of the light sources 38A. 38B, to 38N of the illuminating 
unit 38. The illumination control unit 40 may be used for switching one or more of 
the light sources 38A, 38B, to 38N on or off, and/or for controlling the intensity of 
the light produced by one or more of the light sources 38A, 38B, to 38N, as is 
disclosed in detail hereinafter. 

The controller/processor unit 36 may be suitably connected to the 
illumination control unit 40 for (optionally) sending control signals thereto. Such 
control signals may be used for synchronizing or timing the energizing of the light 
sources 38A, 38B, 38N within the illuminating unit 38, relative to the imaging 
cycle or period of the imaging unit 32. The illumination control unit 40 may be 
(optionally) integrated within the controller/processor unit 36, or may be a 
separate controller. In some embodiments, illumination control unit 40 and/or 
controller/processor unit 36 may be part of telemetry unit 34. 

The device 30 may further include a light sensing unit(s) 42 for sensing the 
light produced by the illuminating unit 38 and reflected from the walls of the Gl 
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tract. The light sensing unit(s) 42 may comprise a single light sensitive device or 
light sensor, or a plurality of discrete light sensitive device(s) or light sensor(s), 
such as but not limited to, a photodiode, a phototransistor, or the like. Other 
types of light sensors known in the art and having suitable characteristics may 
also be used for implementing the light sensing unit or units of embodiments of 
the present invention. 

The light, sensing unit(s) 42 may be suitably connected to the illumination 
control unit 40 for providing the illumination control unit 40 with a signal 
representative of the intensity of the light reflected from the walls of the 
gastrointestinal tract (or any other object within the field of view of the imaging 
unit 32). In operation, the illumination control unit 40 may process the signal 
received from the light sensing unit(s) 42 and, based on the processed signal, 
may control the operation of the light source(s) 38A, 38B, to 38N as is disclosed 
in detail hereinabove and hereinafter. 

The device 30 may also include a power source 44 for providing power to 
the various components of the device 30. It is noted that for the sake of clarity of 
illustration, the connections between the power source 44 and the circuits or 
components of the device 30 which receive power therefrom, are not shown in 
detail. The power source 44 may be, for example, an internal power source 
similar to the power source(s) 25 of the device 10A, e.g., a battery or other power 
source. However, if the device 30 is configured as an insertable device (such as, 
for example, an endoscope-like device or a catheter -like device, or any other 
type of in vivo imaging device known in the art), the power source 44 may also be 
an external power source which may be placed outside the device 30 (such an 
external configuration is not shown in Fig. 2 for the sake of clarity of illustration). 
In such an embodiment having an external power source (not shown), the 
external power source (not shown) may be connected to the various power 
requiring components of the imaging device through suitable electrical 
conductors (not shown), such as insulated wires or the like. 

It is noted that while for autonomous or swallowable in-vivo imaging device 
such as the device 10A the power source(s) 25 are preferably (but not 
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necessarily) compact power sources for providing direct current (DC), external 
power sources may be any suitable power sources known in the art, including but 
not limited to power sources providing alternating current (AC) or direct current or 
may be power supplies couples to the mains as is known in the art. 

5 The various functions and processes implemented by the swallowable in- 

vivo imaging device may be executed by, for example, a processor unit (e.g., unit 
36 in Fig. 2). . These functions and processes may be implemented by the 
processor unit 36 alone, and/or by alternative units, such as illumination control 
unit 40, telemetry unit 34, light sensing units 42, imaging unit 32 etc., or any 

10 combination of units. The various units may optionally be integrated within the 
processor unit 36, such that the processor unit can be said to implement any of 
the functions and processes herein described. The methods and processes 
described may be also embodied in other sensing devices having other 
structures and other components. 

15 Reference is now made to Figs. 3 and 4. Fig. 3 is a schematic cross- 

sectional view of part of an in-vivo imaging device having an automatic 
illumination control system and four light sources, in accordance with an 
embodiment of the present invention. Fig. 4 is a schematic front view of the 

device illustrated in Fig. 3. 

20 The device 60 (only part of which is shown in Fig. 3) includes an imaging 

unit 64. The imaging unit 64 may be similar to the imaging unit 32 of Fig. 2 or to 
the imaging unit 24 of Fig.1. Preferably, the imaging unit 64 may be a CMOS 
imaging unit, but other different types of imaging units may be also used. The 
imaging unit 64 may include CMOS imager circuitry, as is known in the art, but 

25 may also include other types of support and or control circuitry therein, as is 
known in the art and disclosed, for example, in U.S. patent 5,604,531 to Iddan et 
al., or in Co-pending PCT Patent Application, Publication No. WO 01/65995 to 
Glukhovsky et al. The device 60 also includes an optical unit 62 which may 
comprise a lens or a plurality of optical elements as disclosed hereinabove for 

30 optical unit 22 of Fig. 1 and the optical unit 32A of Fig. 2. 
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The device 60 may include an illuminating unit 63, which may include four 
light sources 63A, 63B, 63C and 63D which may be disposed within the device 
60 as shown in Fig. 4. The light sources 63A, 63B. 63C and 63D may be the 
white LED light sources or as disclosed, for example, in Co-pending US Patent 
Application, PCT Patent Application, Publication No. WO 01/65995 to 
Glukhovsky et al., but may also be any other suitable type of light sources, 
including but not limited to, infrared light sources, monochromatic light sources, 
band limited light sources known in the art or disclosed hereinabove. 

It is noted that while in accordance with one embodiment of the present 
10 invention the light sources 63A, 63B, 63C and 63D are shown to be identical, 
other embodiments of the invention may be implemented with multiple light 
sources which may not be identical. Some of the light sources may have a 
spectral distribution, which is different than the spectral distribution of the other 
light sources. For example, of the light sources within the same device, one of 
15 the light sources may be a red LED, another light source may be a blue LED and 
another light source may be a yellow LED. Other configurations of light sources 
are also possible. 

The device 60 may also include a baffle 70, which may be conically 
shaped or which may have any other suitable shape. The baffle 70 may have an 

20 aperture 70A therein. The baffle 70 may be interposed between the light sources 
63A, 63B, 63C and 63D and the optical unit 62 and may reduce the amount of 
light coming directly from the light sources 63A, 63B, 63C and 63D to enter the 
aperture 70A. The device 60 may include a transparent optical dome 61 similar 
to the optical dome 21 of Fig. 1. The optical dome 61 may be made from a 

25 suitable transparent plastic material or glass or from any other suitable material 
which is sufficiently transparent to at least some of the wavelengths of light 
produced by the light sources 63A, 63B, 63C and 63D to allow for adequate 
imaging. 

The device 60 may further include at least one light sensing unit 67 for 
30 sensing light, which is reflected from or diffused by the intestinal wall 76. The 
light sensing unit may be attached to the. baffle 70 such that its light sensitive part 
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67A faces the optica! dome 61 . Preferably, but not necessarily, the light sensing 
unit 67 may be positioned on the surface of baffle 70 at a position which allows 
the light sensing unit 67 to sense an amount of light which is representative or 
proportional to the amount of light entering the aperture 70A of the baffle 70. 
This may be true when the illuminated object is semi-diffusive (as the intestinal 
surface may be), and when the size of the light sensing unit 67 and its distance 
from the imaging sensor axis 75 are small compared to the diameter D of the 
capsule like device 60. 

The device 60 (Fig. 3) is illustrated as being adjacent to the intestinal wall 
76. In operation, light rays 72 which are generated by the light sources 63A, 
63B, 63C and 63D may penetrate the optical dome 61 and may be reflected from 
the intestinal wall 76. Some of the reflected light rays 74 may reach the light- 
sensing unit 67. Other reflected light rays (not shown) may reach the aperture 
70A and pass the optical unit 62 to be focused on the imaging unit 64. 
15 The amount of light measured by the light-sensing unit 67 may be 

proportional to the amount of light entering the aperture 70A. Thus, the 
measurement of the light intensity reaching the light sensing unit 67 may be used 
to determine the light output of the light sources 63A, 63B, 63C and 63D as is 
disclosed in detail hereinafter. 
20 The device 60 also includes an illumination control unit 40A. The 

illumination control unit 40A is suitably coupled to the light sensing unit 67 and to 
the illuminating unit 63. The illumination control unit 40A may process the signal 
received from the light sensing unit 67 to control the light sources 63A, 63B, 63C 
and 63D as is disclosed in detail hereinafter. 
25 The device 60 may also include a wireless transmitter unit (not shown in 

Fig. 3) and an antenna (not shown in Fig. 3), such as but not limited to the 
transmitter 26 and the antenna 27 of Fig. 1 or may include any suitable telemetry 
unit (such as, but not limited to the telemetry unit 34 of Fig. 2). The telemetry unit 
may be a transmitter or a transceiver, for wirelessly transmitting (and optionally 
30 also receiving) data and control signals to (and optionally from) an external 
receiver/recorder (not shown in Fig. 3) as disclosed in detail hereinabove. The 
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device 60 may also include one or more power sources such as, for example, the 
power sources 25 of Fig. 1, or any other suitable power sources, known in the 
art. 

Reference is now made to Fig. 5 which is a schematic diagram illustrating 
5 a method of timing of the illumination and image acquisition in an in vivo imaging 
device having a fixed illumination duration. The timing method may be 
characteristic for imaging devices having CMOS imagers but may also be used in 
devices having other types of imagers. 

An image acquisition cycle or period starts at the time T. The first image 
10 acquisition cycle ends at time T1 and has a duration AT1. The second image 
acquisition cycle starts at time T1 , ends at time T2 and has a duration AT1. Each 
imaging cycle or period may comprise two parts, an illumination period 90 having 
a duration AT2, and a dark period 92 having a duration AT3. The illumination 
periods 90 are represented by the hashed bars of Fig. 5. During the illumination 
15 period 90 of each imaging cycle, the illumination unit (such as but not limited to 
the illuminating unit 38 of Fig. 2, or the illuminating unit 63 of Fig. 3) is turned on 
and provides light for illuminating the intestinal wall. During the dark period 92 of 
each imaging cycle, the illuminating unit (such as but not limited to the 
illuminating unit 38 of Fig. 2, or the illuminating unit 63 of Fig. 3) is switched off 
20 and does not provide light. 

The dark period 92, or a part thereof, may be used for, for example, to 
acquiring an image from the imager by, for example, scanning the pixels of the 
imager and for processing the imager output signals and for transmitting the 
output signals or the processed output signals to an external receiver or 
25 receiver/recorder device, as disclosed hereinabove. 

It is noted that while for the sake of simplicity, the diagram of Fig. 5 
illustrates a case in which the image acquisition cycle duration is fixed, and 
imaging is performed at a fixed frame rate, this is not mandatory. Thus, the 
frame rate and therefore the image acquisition cycle duration may vary during 
30 imaging in accordance with a measured parameter such as, for example the 
velocity of the imaging device within the gastrointestinal tract. 
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Generally, different types of light control methods may be used for 
ensuring adequate image acquisition. 

In a first method, the amount of light impinging on the light sensing unit 67 
may be continuously measured and recorded during the illumination of the target 
5 tissue by the illuminating unit 63 to provide a cumulative value representative of 
the total cumulative number of photons detected by the light sensing unit 67. 
When this cumulative value reaches a certain value, the illuminating unit 63 may 
be shut off by switching off the light sources 63A, 63B, 63C, and 63D included in 
the illuminating unit 63. In this way the device 60 may ensure that when the 
0 quantity of measured light is sufficient to result in an adequately exposed frame 
(on the average), the illuminating unit 63 is turned off. 

One advantage of the first method is that if the light sources (such as the 
light sources 63A, 63B, 63C, and 63D) are operated at their maximal or nearly 
maximal light output capacity, the switching off may save energy when compared 
15 to the energy expenditure in a fixed duration illumination period (such as the 
illumination period 90 of Fig. 5). 

Another advantage of the first method is that it enables the shortening of 
the duration of the illumination period within the imaging cycle in comparison with 
using a fixed illumination period. In a moving imaging device, such as the device 
20 60, ideally, it may be desirable to have the illumination period as short as 
practically possible, since this prevents or reduces image smearing due to the 
movement of the device 60 within the Gl tract. Thus, typically, in a moving 
imaging device, the shorter the illumination period, the sharper will the resulting 
image be (assuming that enough light is generated by the illuminating unit to 
25 ensure adequate imager exposure). 

This may be somewhat similar to the increasing of the shutter speed in a 
regular shutter operated camera in order to decrease the duration of exposure to 
light to prevent smearing of the image of a moving object or image, except that in 
embodiments of the present method there is typically no shutter and the 
30 illumination period is being shortened controllably to reduce image smearing due 
to device movements in the Gl tract. 
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Reference is now made to Figs. 6 and 7. Fig. 6 is a schematic diagram 
illustrating one possible configuration for an illumination control unit coupled to a 
light sensing photodiode and to a light emitting diode, in accordance with an 
embodiment of the present invention. Fig. 7 is a schematic diagram illustrating 

5 the illumination control unit of Fig. 6 in detail, in accordance with an embodiment 
of the present invention. 

The illumination control unit 40B of Fig. 6 may be suitably connected to a 
photodiode 67B, which may be operated as a light sensing unit. Any other 
suitable sensing unit or light sensor may be used. The illumination control unit 

10 40B may be suitably connected to a light emitting diode (LED) 63E. The LED 
63E may be a white LED as disclosed hereinabove or may be any other type of 
LED suitable for illuminating the imaged target (such as the gastrointestinal wall). 
The illumination control unit 40B may receive a current signal from the 
photodiode 67B. The received signal may be proportional to the intensity of light 

15 (represented schematically by the arrows 81) impinging the photodiode 67B. The 
illumination control 40B may process the received signal to determine the amount 
of light that illuminated the photodiode 67B within the duration of a light 
measuring time period. The illumination control 40B may control the energizing 
of the LED 63E based on the amount of light that illuminated the photodiode 67B 

20 within the duration of the light measuring time period. Examples of the type of 
processing and control of energizing are disclosed in detail hereinafter. The 
illumination control unit 40B may also receive control signals from other circuitry 
components included in the in vivo imaging device. For example, the control 
signals may include timing and/or synchronization signals, on/off switching 

25 signals, reset signals, or the like. 

The light sensing unit(s) and light producing unit(s) may be any suitable 
light producing or sensing units other than diodes. 

Fig. 7 illustrates one possible embodiment of the illumination control unit 
40B. The illumination control unit 40B may include, for example, an integrator 

30 unit 80, a comparator unit 82 and a LED driver unit 84. The integrator unit 80 is 
coupled to the photodiode 67B to receive therefrom a signal indicative of the 
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intensity of the light impinging on the photodiode 67B, and to record and integrate 
the amount of light impinging on the photodiode 67B. The integrator unit 80 may 
be suitably connected to the comparator unit 82. 

The integrator unit 80 may record and integrate the amount of light 
impinging on the photodiode 67B, integrating the received signal, and output an 
integrated signal to the comparator unit 82. The integrated signal may be 
proportional to or indicative of the cumulative number of photons hitting the 
photodiode 67B over the integration time period. The comparator unit 80 may be 
suitably connected to the LED driver unit 84. The comparator unit 80 may 
continuously compare the value of the integrated signal to a preset threshold 
value. When the value of the integrated signal is equal to the threshold value, 
the comparator unit 82 may control the LED driver unit 84 to switch off the power 
to the LED 63E and thus cease the operation of the LED 63E. 

Thus, the illumination control unit 40A may be constructed and operated 
15 similar to the illumination control unit 40B of Figs. 7 and 8. 

It is noted that while the circuits illustrated in Fig. 7 may be implemented 
as analog circuits, digital circuits and/or hybrid analog/digital circuits may be used 
in implementing the illumination control unit, as is disclosed in detail hereinafter 

(with respect to Fig. 11). 

Reference is now made to Fig. 8, which is a schematic diagram useful for 
understanding a method of timing of the illumination and image acquisition in an 
in vivo imaging device having a variable controlled illumination duration, 

according to one embodiment. 

An image acquisition cycle or period starts at the time T. The first image 
acquisition cycle ends at time T1 and has a duration AT1. The second image 
acquisition cycle starts at time T1. ends at time T2 and has a duration ATI. In 
each imaging cycle, the time period having a duration AT4 defines the maximal 
allowable illumination period. The maximal allowable illumination period AT4 
may typically be a time period which is short enough as to enable imaging 
without excessive image smearing or blurring due to the movement of the device 
60 within the Gl tract. The time T M is the time of the end of the maximal 
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allowable illumination period AT4 relative to the beginning time of the first 
imaging cycle. 

The maximal allowable illumination period AT4 may be factory preset 
taking into account, inter alia, the typical or average (or maximal) velocity 
reached by the imaging device within the Gl tract, (as may be determined 
empirically in a plurality of devices used in different patients), the type of the 
imaging sensor (such as, for example, the CMOS sensor 64 of the device 50) 
and its scanning time requirements, and other manufacturing and timing 
considerations. In accordance with one implementation of the invention, when 
imaging at 2 frames per second AT1= 0.5 second, the duration of AT4 may be set 
to have a value in the range of 20-30 milliseconds. However, this duration is 
given by way of example only, and AT4 may have other different values. 
Typically, the use of a maximal allowable illumination period AT4 of less than 30 
milliseconds may result in acceptable image quality of most of the acquired 
image frames without excessive degradation due to blurring of the image 
resulting from movement of the imaging device within the Gl tract. 

The time period AT5 is defined as the difference between the entire 
imaging cycle duration AT1 and the maximal allowable illumination period AT4 
(AT5 = AT1 - AT4). 

At the time of beginning T of the first imaging cycle, the illumination unit 
(such as but not limited to the illuminating unit 63 of Fig. 3) is turned on and 
provides light for illuminating the intestinal wall. The light sensing unit 67 senses 
the light reflected and/or diffused from the intestinal wall 76 and provides a signal 
to the illumination control unit 40A of the device 60. The signal may be 
proportional to the average amount of light entering the aperture 70A. The signal 
provided by the light sensing unit 67 may be integrated by the illumination control 
unit 40A as is disclosed in detail hereinabove with respect to the illumination 
control unit 40B of Figs. 7 and 8. 

The integrated signal may be compared to a preset threshold value (for 
example by a comparator such as the comparator unit 82 of Fig. 7). When the 
integrated signal is equal to the threshold value, the illumination control unit 40A 
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ceases the operation of the light sources 63A, 63B, 63C and 63D of the 
illuminating unit 63. The time TE1 is the time at which the illuminating control unit 
turns off the light sources 63A, 63B, 63C and 63D within the first imaging cycle. 
The time interval beginning at time T and ending at time TE1 is the illumination 
5 period 94 (represented by the hashed bar labeled 94) for the first imaging cycle. 
The illumination period 94 has a duration of AT6. It may be seen that for the first 

imaging cycle AT6 < AT4. 

After the time TE1 the scanning of the pixels CMOS sensor 64 may begin 
and the pixel data (and possibly other data) may be transmitted by the transmitter 

10 (not shown in Fig. 3) or telemetry unit of the device 60. 

Preferably, the scanning (read out) of the pixels of the CMOS sensor 64 
may begin as early as the time TE1 of the termination of the illumination. For 
example the illumination control unit 40A may send a control signal to the CMOS 
sensor at time TE1 to initiate the scanning of the pixels of the CMOS sensor 64. 

15 However, the scanning of the pixels may also begin at a preset time after the 
time T M which is the ending time of the maximal allowable illumination period 
AT4, provided that sufficient time is available for pixel scanning and data 
transmission operations. According to one embodiment, keeping the start of 
readout time fixed, for example at Tm, may enable simpler implementation of the 

20 receiving unit. 

At the time of beginning T1 of the second imaging cycle, the illuminating 
unit 63 is turned on again. The light sensing unit 67 senses the light reflected 
and/or diffused from the intestinal wall 76 and provides a signal to the illumination 
control unit 40A of the device 60. The signal may be proportional to the average 

25 amount of light entering the aperture 70A. 

The signal provided by the light sensing unit 67 may be integrated and 
compared to the threshold value as disclosed hereinabove for the first imaging 
cycle. When the integrated signal is equal to the threshold value, the illumination 
control unit 40A turns off the light sources 63A, 63B, 63C and 63D of the 

30 illuminating unit 63. However, in the particular schematic example illustrated in 
Fig. 8,. the intensity of light reaching the light sensing unit 67 in the second 
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imaging cycle is lower than the intensity of light reaching the light sensing unit 67 
in the first imaging cycle. 

This difference of the illumination intensity or intensity versus time profile 
between different imaging cycle may be due to, inter alia, movement of the 
5 device 60 away from the intestinal wall 76, or a change of the position or 
orientation of the device 60 with respect to the intestinal wall 76, or a change in 
the light absorption or light reflecting or light diffusion properties of the part of the 
intestinal wall 76 which is within the field of view of the device 60. 

Therefore it takes longer for the integrated signal output of the integrator 
10 unit to reach the threshold value. Therefore, the illumination control unit 40A 
turns the illuminating unit 63 off at a time TE2 (it is noted that TE2 >TE1 ). 

The time interval beginning at time T1 and ending at time TE2 is the 
illumination period 96 for the second imaging cycle. The illumination period 96 
(represented by the hashed bar labeled 96) has a duration AT7. It may be seen 
15 that for the second imaging cycle AT7< AT4. 

Thus, the duration of the illumination period within different imaging cycles 
may vary and may depend, inter alia, on the intensity of light reaching the light 
sensing unit 67. 

After the time TE2 the scanning of the pixels CMOS sensor 64 may begin 
20 and the pixel data (and possibly other data) may be transmitted as disclosed in 
detail hereinabove for the first imaging cycle of Fig. 8. 

It is noted that while for the sake of simplicity, the diagram of Fig. 8 
illustrates a case in which the image acquisition cycle duration AT1 is fixed, and 
imaging is performed at a fixed frame rate, this is not mandatory. Thus, the 
25 frame rate and therefore the image acquisition cycle duration AT1 may vary 
during imaging in accordance with a measured parameter such as, for example 
the velocity of the imaging device within the gastrointestinal tract. In such cases, 
the duration of the imaging cycle may be shortened or increased in response to 
the measured velocity of the device 60 in order to increase or decrease the frame 
30 rate, respectively. 



P-4257-IL1 



21 



For example, co-pending U.S. patent Application, Serial Number 
09/571,326, filed May 15, 2000, co-assigned to the assignee of the present 
application, incorporated herein by reference in its entirety for all purposes, 
discloses, inter alia, a device and method for controlling the frame rate of an in- 

vivo imaging device. 

The automatic illumination control methods disclosed hereinabove may be 
adapted for use in device having variable frame rate. Such adaptation may take 
into account the varying duration of the imaging cycle and the implementation 
may depend, inter alia, on the amount of time required to complete the pixel 
scanning and the data transmission, the available amount of power available to 
the device 60, and other considerations. 

A simple way of adapting the method may be to limit the maximal frame 
rate of the imaging device, such that even when the maximal frame rate is being 
used, there will be enough time left for pixel scanning and data transmission 
within the time period. 

Reference is now made to Fig. 9, which is a schematic diagram useful for 
understanding a method of timing of the illumination and image acquisition in an 
in vivo imaging device having a variable frame rate and a variable controlled 
illumination duration. 

The first imaging cycle of Fig. 9 is similar to the first imaging cycle of Fig. 8 
except that the duration of the illumination period 98 of Fig. 9 (represented by the 
hashed bar labeled 98) is longer than the duration of the illumination period 94 of 
Fig. 8. The first imaging cycle of Fig. 9 starts at time T, ends at time T1 , and has 
a duration AT1. The time T M represents the end of the maximal allowable 
25 illumination period AT4. The second imaging cycle of Fig. 9 begins at time T1 
and ends at time T3. The duration of the second imaging cycle AT8 is shorter 
than the duration of the first imaging cycle AT1 (AT8<AT1). The duration of the 
second imaging cycle AT8 corresponds to the highest frame rate usable in the 
imaging device. The illumination period 100 of the second imaging cycle 
30 (represented by the hashed bar labeled 100 of Fig. 9) is timed by the illumination 
control unit depending on the light intensity as disclosed in detail hereinabove. 
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The time period 102 (represented by the dotted bar labeled 102) represents the 
amount of time AT9 required for scanning the pixels of the imager and 
transmitting the scanned frame data. T M represents the time of ending of the 
maximal allowable illumination period relative to the beginning time of each 
5 imaging cycle. Thus, if the frame rate is increased, even at the highest possible 
frame rate there is enough time to scan the pixels and transmit the data. 

It is noted that typically, in an exemplary in vivo imaging device having a 
fixed frame rate, the time requited for scanning the pixels of a CMOS sensor 
having approximately 66,000 pixels (such as but not limited to a CMOS sensor 
[0 arranged in a 256 X 256 pixel array), and for transmitting the digital (serial) data 
signals to an external receiver recorder may be approximately 0.4 seconds 
(assuming a scanning and data transmission time of approximately 6 
microseconds per pixel). Thus, assuming a maximal illumination period of 
approximately 20-30 milliseconds, the frame rate may not be extended much 
15 higher than 2 frames per second. Alternate frame rates may be used for 
example, for implementing different readout rates. 

It may however be possible to substantially shorten the time required for 
scanning the pixels and for transmitting the data. For example, by increasing the 
clock rate of the CMOS pixel array, it may be possible to reduce the time required 
20 to scan an individual frame to 3 microseconds or even less. Additionally, it may 
be possible to increase the data transmission rate of the transmitter 26 to even 
further shorten the overall time required for scanning the array pixels for 
transmitting the pixel data to the external receiver/recorder. 

Therefore, variable frame rate in vivo imaging devices, as well as fixed 
25 frame rate devices, may be implemented which may be capable of frame rates of 
approximately 4-8 frames per second, and even higher. 

When the method disclosed hereinabove for turning off the illuminating 
unit when the integrated output of the light sensing unit reaches a threshold value 
adapted to ensure a good average image quality is implemented, the tendency of 
30 the designer may be to operate the illuminating unit (such as, for example the 
illuminating unit 63 of Fig. 3) close to the maximal available light output capacity. 
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This may be advantageous because of the shortened illumination period duration 
achievable which may improve image clarity by reducing movement induced 
image blurring. 

It may not always be possible or desired to operate the illuminating unit 
5 close to the maximal possible light output capacity. Therefore, it may be desired 
to start the operation of the illuminating unit 63 at a given light output which is 
lower than the maximal light output of illuminating unit 63. 

In a second illumination control method, the illuminating unit 63 of Fig. 3 
may be initially operated at a first light output level at the beginning of each of the 
10 imaging cycles. The light sensing unit 67 may be used to measure the amount of 
light during a short illumination sampling period. 

Reference is now made to Figs. 10A. 10B and 10C. Fig 10A is a timing 
diagram schematically illustrating an imaging cycle of an in vivo imaging device 
using an automatic illumination control method in accordance with another 
15 embodiment of the present invention. Fig. 10B is an exemplary schematic graph 
representing an example of the light intensity as a function of time, possible when 
using the method of automatic illumination control illustrated in Fig. 10A. Fig. 
10C is a schematic graph representing another example of the light intensity as a 
function of time, possible when using the method of automatic illumination control 

20 illustrated in Fig. 10A. 

In Figs. 10A, 10B and 10C, the horizontal axes of the graphs represents 
time in arbitrary units. In Figs. 10B and 10C, the vertical axis represents the 
intensity I of the light output by the illuminating unit 63 (Fig. 3). 

The automatic illumination control method illustrated in Fig. 10A operates 

25 by using an illumination sampling period 104 included in a total illumination 
period 108. An imaging cycle 110 includes the total illumination period 108 and a 
dark period 112. The illuminating unit 63 may illuminate the intestinal wall 76 
within the duration total illumination period 108. The dark period 112 may be 
used for scanning the pixels of the CMOS imager 64 and for processing and 

30 transmitting the image data as disclosed in detail hereinabove. 
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The total illumination period of the imaging cycle starts at time T and ends 
at time T M . The time T M is fixed with respect to the beginning time T of the 
imaging cycle 110, and represents the maximal allowable illumination time. 
Practically, the time T M may be selected to reduce the possibility of image 
5 blurring as explained hereinabove. For example, the time T M may be selected as 
20 milliseconds from the time of beginning T of the imaging cycle 110 (in other 
words, the duration of the total illumination period 108 may be set at 30 
milliseconds), but other larger or smaller values of the time T M and of the total 
illumination period 108 may also be used. 
10 The total illumination period 108 may include an illumination sampling 

period 104 and a main illumination period 106. The illumination sampling period 
104 starts at time T and ends at time T s . The main illumination period 106 starts 
at time Ts and ends at time Tm- 

In an exemplary embodiment of the method, the duration of the 
15 illumination sampling period 104 may be set at approximately 2-5 milliseconds, 
but other larger or shorter duration values may be used depending, inter alia, on 
the type and characteristics of the light sensing unit 67, its sensitivity to light, its 
signal to noise ratio (S/N), the intensity h at which the illuminating unit 63 is 
operated during the illumination sampling period 104, and other implementation 
20 and manufacturing considerations. 

Turning to Figs. 10B and 10C, during the illumination sampling period 104, 
the illuminating unit 63 is operated such that the intensity of light is U. The light 
sensing 67 may sense the light reflected from and diffused by the intestinal wall 
76. The illumination control unit 40A may integrate the intensity signal to 
25 determine the quantity Q of light reaching the light sensing unit 67 within the 
duration of the illumination sampling period 104. The illumination control unit 40A 
may then compute from the value Q and from the known duration of the main 
illumination period 106, the intensity of light l N at which the illuminating unit 63 
needs to be operated for the duration of the main illumination period 106 in order 
30 to provide adequate average exposure of the CMOS sensor 64. In one 
embodiment an estimated total amount of light received is kept substantially 
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constant across a set of imaging cycles, or is kept within a certain target range. 
The computation may be performed, for example, by subtracting from a fixed light 
quantity which is desired to be received or applied the amount of light recorded 
during the sampling period 104 and dividing the result by a fixed time period 
which corresponds to the main illumination period 106. One possible way to 
perform the computation would be using equation 1 as follows: 

I n =(Qt-Q)/ATmain equation 1 

Wherein, 

ATmain is the duration of the main illumination period 1 06, 
Qt is the total quantity of light that needs to reach the light sensing unit 67 
within an imaging cycle to ensure adequate average exposure of the 
CMOS sensor 64, and Q is the quantity of light reaching the light sensing 
unit 67 within the duration of an illumination sampling period 104 of an 
imaging cycle. 

It is noted that the value of Qt may be empirically determined. 

Figs. 10B schematically illustrates a graph showing the intensity of light 
produced by the illuminating unit 63 as a function of time for an exemplary 
imaging cycle. During the illumination sampling period 104 the light intensity has 
a value U. After the end of the illumination sampling period 104, the light 
intensity l N = l 2 may be computed as disclosed in equation 1 hereinabove, or by 
using any other suitable type of analog or digital computation. 

For example, if the computation is digitally performed by the 
controller/processor 36 of Fig. 2, the value of l N may be computed within a very 
short time (such as for example less than a microsecond) compared to the 
duration of the main illumination period 106. 

If the computation of l N is performed by an analog circuit (not shown) 
which may be included in the illumination control unit 40 of Fig. 2, or in the 
illumination control unit 40B of Fig. 6, or in the illumination control unit 40A of Fig. 
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3, the computation time may also be short compared to the duration of the main 
illumination period 106. 

After the computation of l 2 for the imaging cycle represented in Fig. 10B is 
completed, the illumination control unit 40A may change the intensity of the light 

5 output of the illuminating unit of the imaging device to I* This may be achieved, 
for example, by increasing the amount of current output from the LED driver unit 
84 of Fig. 7, or . by increasing the amount of current output from one or more LED 
driver units (not shown in detail) which may be included in the illumination control 
unit 40A to supply current to the light sources 63A, 63B, 63C, and 63D. At the 

10 end of the main illumination period 108 (at time T M ), the illumination control unit 
40A may switch the illuminating unit 63 off until time T1 which is the beginning of 
a new imaging cycle (not shown). At the beginning of the new imaging cycle, the 
light intensity is switched again to the value I1 and a new illumination sampling 
period begins. 

15 Fig. 10C schematically illustrates a graph showing the intensity of light 

produced by the illuminating unit 63 as a function of time for another different 
exemplary imaging cycle. The illumination intensity I1 is used throughout the 
illumination sampling period 104 as disclosed hereinabove. In this imaging cycle, 
however, the value of Q measured for the illumination sampling period 104 is 

20 higher than the value of Q measured for the illumination sampling period of Fig. 
10B. This may happen, for example, due to movement of the position of the 
imaging device 60 relative to the intestinal wall 76. Therefore the computed 
value of l 3 is lower than the value of l 2 of the imaging cycle illustrated in Fig. 10B. 
The value of l 3 is also lower than the value of U. Thus, the intensity of light 

25 emitted by the illuminating unit 63 during the main illuminating period 106 
illustrated in Fig. 10C is lower than the intensity of light emitted by the illuminating 
unit 63 during the illumination sampling period 104 of Fig. 10C. 

It is noted that if the computed value of l 3 is equal to the value of U (case 
not shown in Figs. 10B-10C) the illumination intensity may be maintained at the 

30 initial value of I1 for the duration of the total illumination period 108, and no 
modification of the illumination intensity is performed at time T M . 
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An advantage of the second illumination control method disclosed 
hereinabove may be that it may at least initially avoid the operating of the 
illuminating unit 63 at its maximal light output intensity. This may be useful for 
improving the performance of the power sources, such as, for example, the 
power source(s) 25 of Fig. 1, and may extend the useful operational life thereof. 
It is known in the art that many batteries and electrochemical cells do not perform 
optimally when they are operated near their maximal current output. When using 
the second illumination method, the light sources (such as the light sources 63A, 
63B, 63C, and 63D of Fig. 3) are initially operated at a light intensity li which may 
be a fraction of their maximal output light intensity. Thus, in cases where it is 
determined that the maximal light output intensity is not required for the current 
frame acquisition, the light sources may be operated at a second light intensity 
level (such as, for example the light intensity level fe which is lower than the light 
intensity level li). Thus, the second illumination control method may reduce the 
15 current required for operating the illuminating unit 63 drawn from the batteries or 
other power sources of the imaging device which may extend the useful 
operational life of the batteries or of other power sources used in the imaging 
device. According to one embodiment a combination of both methods (variable 
duration and variable intensity) is possible. 



10 
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It will be appreciated by those skilled in the art that the embodiments of 
the present invention are not limited to the use of a single light sensing element 
and/or a single light source. Additionally, it will be appreciated that the light 
sensing elements may include photo detectors that are separate from an imager, 

25 or are part of an imager. 

Reference is now made to Fig. 11 which is a schematic diagram 
illustrating an illumination control unit for controlling a plurality of light sources, in 
accordance with an embodiment of the present invention. 

The illumination control unit 120 includes a plurality of light sensing units 
30 122A, 122B.....122N, suitably interfaced with a plurality of analog to digital (A/D) 
converting units 124A, 124B....124N, respectively. The A/D converting units are 
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suitably connected to a processing unit 126. The processing unit 126 is suitably 
connected to a plurality of LED drivers 128A, 128B....128N which are suitably 
connected to a plurality of LED light sources 130A, 130B....130N. 

Signals representing the intensity of light sensed by the light sensing units 
5 122A, 122B.....122N are fed to the A/D converting units 124A, 124B....124N, 
respectively, which output digitized signals. The digitized signals may be 
received by the processing unit 126 which may process the signals. For example 
the processing unit 136 may perform integration of the signals to compute the 
quantity of light sensed by one or more of the light sensing units 122A, 

10 122B 122N. The computed quantity of light may be the total combined 

quantity of light sensed by all the light sensing units122A, 122B 122N taken 

together, or may be the individual quantities of light separately computed for 

each individual light sensing unit of the light sensing units 122A, 122B 122N. 

The processing unit 136 may further process the computed light quantity 
15 or light quantities, to provide control signals to the LED drivers 128A, 
128B....128N which in turn may provide, individually or in combination, suitable 
currents to the LED light sources 130A, 130B....130N. According to one 
embodiment of the present invention, each sensor may be directly related to one 
or more illumination sources. 
20 According to some embodiments of the present invention, individual 

control of illumination sources may be enabled by using special control pixels. 
These control pixels may be adapted for fast read-out, which is well known in the 
art. A fast read-out procedure may not reset the pixel values. 

it is noted that the illumination control unit 120 of Fig. 11 may be operated 
25 using different processing and control methods. 

In accordance with one embodiment of the present invention, all the light 
sensing units 122A, 122B.....122N may be used as a single light sensing element 
and the computation is performed using the combined total quantity of light to 
simultaneously control the operation of all the LED light sources 130A, 
30 130B....130N together. In this embodiment, the illumination control unit 120 may 
be implemented using, for example, the first illumination control method as 
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disclosed hereinabove and illustrated in Figs. 5, 8, and 9, which uses a fixed 
illumination intensity and computes the termination time of the illumination. 
According to other embodiments multiple A/D units (e.g. ,124) are not included, 
rather analog processing is performed. 

5 Alternatively, in accordance with another embodiment of the present 

invention, the illumination control unit 120 may be implemented using the second 
illumination control method, for example, as disclosed hereinabove and illustrated 
in Figs. 10A-10C which uses a first illumination intensity h in an illumination 
sampling period and computes a second light intensity In for use in a main 

10 illumination period as disclosed in detail hereinabove. In such a case, the 
illumination intensity U used throughout the illumination sampling period 104 (see 
Figs. 10A-10C) may be identical for all the LED light sources 130A, 
130B....130N, and the illumination intensity l N used throughout the main 
illumination period 106 (Figs. 10A-10C) may be identical for all the LED light 

15 sources 130A, 130B....130N. 

In accordance with another embodiment of the present invention, each of 

the light sensing units 122A, 122B 122N may be used as a separate light 

sensing unit and the computation may be performed using the individual 
quantities of light sensed by each of the light sensing units122A, 122B.....122N 

20 to differentially control the operation of at least one of the LED light sources 
130A, 130B, ...130N respectively or in any combination. In this embodiment, the 
illumination control unit 120 may be implemented using the first illumination 
control method as disclosed hereinabove and illustrated in Figs. 5, 8, and 9, 
which uses a fixed illumination intensity for each of the LED light sources 130A, 

25 130B....130N and may separately compute the termination time of the 
illumination for each of the LED light sources 130A, 130B....130N. In such a 
manner, sets of light sources 130A, 130B....130N (where a set may include one) 
may be paired with sets of sensors 122A, 122B.....122N. 

Alternatively, in accordance with another embodiment of the present 

30 invention, the illumination control unit 120 may be implemented using the second 
illumination control method as disclosed hereinabove and illustrated in Figs. 10A- 
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10C which uses a first illumination intensity d in an illumination sampling period 
and computes a second light intensity l N for use in a main illumination period as 
disclosed in detail hereinabove. In such a case, the illumination intensity h may 
be identical for all the LED light sources 130A, 130B....130N, and the illumination 
5 intensity I N may be identical for all the LED light sources 130A, 130B,...130N. 

Typically, this embodiment may be used in cases in which the positioning 
of the light sources 130A, 130B, ...130N and the light sensing units122A, 
122B,....122N in the imaging device is configured to ensure that a reasonably 
efficient "local control" of illumination is enabled and that the cross-talk between 

10 different light sources is at a sufficiently low level to allow reasonable local control 
of the illumination intensity produced by a one or more of the light sources130A, 
130B,...130N by processing the signals from one or more light sensing unit which 
are associated in a control loop with the one or more light sources. 

Reference is now made to Fig. 12 which is a schematic diagram 

15 illustrating a front view of an autonomous imaging device having four light 
sensing units and four light sources, in accordance with an embodiment of the 
present invention. 

The device 150 includes four light sources 163A, 163B, 163C and 163D 
and four light sensing units 167A, 167B, 167C and 167D. The light sources 

20 1 63A, 163B, 163C and 163D may be the white LED sources as disclosed 
hereinabove, or may be other suitable light sources. The light sensing 
units167A, 167B, 167C and 167D are attached on the surface of the baffle 70, 
surrounding the aperture 62. The front part of the device 150 may include four 
quadrants 170A, 170B, 170C and 170D. The device 150 may include an 

25 illumination control unit (not shown in the front view of Fig. 12), and all the optical 
components, imaging components, electrical circuitry, and power source(s) for 
image processing and transmitting as disclosed in detail hereinabove and 
illustrated in the drawing Figures (See Figs. 1, 2). 

The quadrants are schematically represented by the areas 170A, 170B, 

30 170C and 170D between the dashed lines. In accordance with an embodiment 
of the invention, the device 150 may include four independent local control loops. 
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For example, the light source 163A and the light sensing unit 167A which are 
positioned within the quadrant 170A may be suitably coupled to the illumination 
control unit (not shown) in a way similar to the coupling of the light sources 38A- 
38N and the light sensing unit(s) 42 to the illumination control unit 40 of Fig. 2. 
The signal from the light sensing unit 167A may be used to control the 
illumination parameters of the light source 163A using any of the illumination 
control methods disclosed hereinabove, forming a local control loop for the 
quadrant 1 70A. 

Similarly, the signal from the light sensing unit 167B may be used to 
control the illumination parameters of the light source 163B using any of the 
illumination control methods disclosed hereinabove, forming a local control loop 
for the quadrant 170B, the signal from the light sensing unit 167C may be used to 
control the illumination parameters of the light source 163C using any of the 
illumination control methods disclosed hereinabove, forming a local control loop 
for the quadrant 170C, and the signal from the light sensing unit 167D may be 
used to control the illumination parameters of the light source 163D using any of 
the illumination control methods disclosed hereinabove, forming a local control 
loop for the quadrant 170D. 

It is noted that there may be some cross-talk or interdependency between 
the different local control loops, since practically, some of the light produced by 
the light source 163A may be reflected from or diffused by the intestinal wall and 
may reach the light sensing units 167B, 167C, and 167D which form part of the 
other local control loops for the other quadrants 170B, 170C, and 170D, 
respectively. 

The arrangement of the positions light sensing units 167A, 167B, 167C 
and 167D and the light sources 163A, 163B, 163C and 163D within the device 
150 may be designed to reduce such cross-talk. 

In other embodiments of the invention it may be possible to use 
processing methods such as "fuzzy logic" methods or neural network 
implementations to link the operation of the different local control loops together. 
In such implementations, the different local control loops may be coupled 
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together such that information from one of the light sensing unit may influence 
the control of illumination intensity of light sources in other local control loops. 

It is noted that, while the imaging device 150 illustrated in Fig. 12 includes 
four light sources and four light sensing units, The number of light sources may 
vary and the imaging device of embodiments of the present invention may be 
constructed with a different number (higher or lower than four) of light sources. 
Similarly, the number of the light sensing units may also vary, and any suitable or 
practical number of light sensing units may be used. Additionally, it is noted that 
the number of light sensing units in a device need not be identical to the number 
of light sources included in the device. Thus, for example, a device may be 
constructed having three light sensing units and six light sources. Or in another 
example, a device may be constructed having ten light sensing units and nine 
light sources. 

The factors determining the number of light sources and the number of 
light sensing units may include, inter alia, the geometrical (two dimensional and 
three dimensional) arrangement of the light sources and the light sensing units 
within the device and their arrangement relative to each other, the size and 
available power of the light sources, the size and sensitivity of the light sensing 
units, manufacturing and wiring considerations. 

The number of local control loops may also be determined, inter alia, by 
the degree of uniformity of illumination desired, the degree of cross-talk between 
the different local control loops, the processing power of the illumination control 
unit available, and other manufacturing considerations. 

The inventors of the present invention have noticed that it is also possible 
to achieve illumination control using one or more of the light sensitive pixels of 
the imager itself, instead of or in addition to using dedicated light sensing unit(s) 
which are not part of the imager. In addition, special light sensing elements may 
be integrated into the pixel array on the surface of the CMOS imager IC. 

For example, in CMOS type imagers, some of the pixels of the CMOS 
imager may be used for controlling the illumination, or alternatively, specially 
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manufactured light sensitive elements (such as, analog photodiodes, or the like) 
may be formed within the pixel array of the imager. 

Reference is now made to Fig. 13 which is a top view schematically 
illustrating the arrangement of pixels on the surface of a CMOS imager usable for 
5 illumination control, in accordance with an embodiment of the present invention. 
It is noted that the pixel arrangement in Fig. 13 is only schematically illustrated 
and the actual physical arrangement of the circuitry on the imager is not shown. 

The surface of the CMOS imager 160 is schematically represented by a 
12X12 array comprising 144 square pixels. The regular pixels 160P are 
10 schematically represented by the white squares. The CMOS imager also 
includes sixteen control pixels 160C, which are schematically represented by the 
hashed squares. 

It is noted that while the number of the pixels in the CMOS imager 160 
was arbitrarily chosen as 144 for the sake of simplicity and clarity of illustration 

15 only, the number of pixels may be larger or smaller if desired. Typically, a larger 
numbers of pixels may be used to provide adequate image resolution. For 
example a 256X256 pixel array may be suitable for Gl tract imaging. 

In accordance with an embodiment of the present invention, the control 
pixels 160C may be regular CMOS imager pixels which are assigned to be 

20 operated as control pixels. In accordance with this embodiment, the control 
pixels 160C may be scanned at a different time than the regular imaging pixels 
160P. This embodiment has the advantage that it may be implemented with a 
regular CMOS pixel array imager. 

Turning back to Fig. 10A, the timing diagram of Fig. 10A may also be 

25 used, according to one embodiment, to illustrate the automatic illumination 
control method using control pixels. The method may operate by using a fast 
scan of the control pixels 160C at the beginning of each imaging cycle 110. The 
illuminating unit (not shown) may be turned on at the beginning of the imaging 
cycle 110 (at time T). The scanning of the control pixels 160C may be performed 

30 similar to the scanning of the regular pixels 160P, except that the scanning of all 
of the control pixels 160C occurs within the illumination sampling period 104. 
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The control pixels 160C may be serially scanned within the duration of the 
illumination sampling period 104. This is possible due to the ability to randomly 
scan any desired pixel in a CMOS pixel array, by suitably addressing the pixel 
readout lines (not shown) as is known in the art. 
5 It is noted that since the control pixels 160C are scanned serially (one 

after the other), the control pixel which is scanned first has been exposed to light 
for a shorter time period than the control pixels which are scanned next. Thus, 
each control pixel is scanned after it has been exposed to light for a different 
exposure time period. 

10 If one assumes that the intensity of light reflected from the intestinal wall 

does not change significantly within the duration of the illumination sampling 
period 104, it may be possible to compensate for this incrementally increasing 
pixel exposure time by computationally correcting the average measured light 
intensity for all the control pixels 160C, or the computed average quantity of light 

15 reaching all the control pixels 160C. For example, a weighted average of the 
pixel intensities may be computed. 

Alternatively, in accordance with another embodiment of the present 
invention, the illuminating unit 63 may be turned off after the end on the 
illumination sampling period 104 (the turning off is not shown in Fig. 10A). This 

20 turning off may enable the scanning of the control pixels 160C while the pixels 
160C are not exposed to light and may thus prevent the above described 
incremental light exposure of the control pixels. 

f After the scanning (readout) of all the control pixels 160C is completed 
and the scanned control pixel signal values are processed (by analog or by digital 

25 computation or processing), the value of the required illumination intensity in the 
main illumination period may be computed, for example, by the illumination 
control unit 40A (or, for example, by the illumination control unit 40 of Fig. 2). 

The computation of the required illumination intensity or of the current 
required from the LED driver unit 84 may be performed as disclosed 

30 hereinabove, using the known value of U (see Fig. 10B) and may or may not take 
into account the duration of the period in which the illuminating unit 63 was 
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turned off (this duration may be approximately known from the known time 
required to scan the control pixels 160C and from the approximate time required 
for the data processing and/or computations). The illumination unit 63 may then 
be turned on (the turning on is not shown in Fig. 10A for the sake of clarity of 

5 illustration) using the computed current value to generate the required 
illumination intensity value l 2 (see Fig. 10B) till the end of the main illumination 
period 106 at time T M . 

It is noted that if the number of control pixels 160C is small the time 
required for scanning the control pixels 160C may be short in comparison to the 

10 total duration of the total illumination period 108. For example, if the scan time 
for scanning a single control pixel is approximately 6 microseconds, the scanning 
of 16 control pixels may require about 96 microseconds. Since the time required 
for computing the required light intensity may also be small (a few microseconds 
or tens of microseconds may be required), the period of time during which the 

15 illumination unit 63 is turned of at the end of the illumination sampling period 104 
may comprise a small fraction of the main illumination period 108 which may 
typically be 20-30 milliseconds. 

It may also be possible to compute a weighted average in which the 
intensity read for each pixel may be differently weighted according to the position 

20 of the particular control pixel within the entire pixel array 160. Such weighting 
methods may be used for obtaining center biased intensity weighting, as is 
known in the art, or any other type of biased measurement known in the art, 
including but not limited to edge (or periphery) biased weighting, or any other 
suitable type of weighting known in the art. Such compensating or weighting 

25 computations may be performed by an illumination control unit (not shown) 
included in the imaging device, or by any suitable processing unit (not shown), or 
controller unit (not shown) included in the imaging device in which the CMOS 
imager 160 illustrated in Fig. 13 is included. 

Thus, if an averaging or weighting computation is used, after the readout 

30 of the control pixels and any type of compensation or weighting computation is 
finished, the illumination control unit (not shown) may compute the value of the 
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weighted (and/or compensated) quantity of light sensed by the control pixels 
160C and use this value for computing the value of b. 

It is noted that the ratio of the number of the control pixels 160C to the 
regular pixels 160P should be a small number. The ratio of 16/144 which is 

5 illustrated is given by example only (for the sake of clarity of illustration). In other 
implementations the ratio may be different depending, inter alia, on the total 
number of pixels in the CMOS array of the imager and on the number of control 
pixels used. For example in a typical 256 X 256 CMOS pixel array it may be 
practical to use 16-128 pixels as illumination control pixels for illumination control 

10 purposes. The number of control pixels in the 256 X 256 CMOS pixel array may 
however also be smaller than 16 control pixels or larger than 128 control pixels. 

Generally, the number of control pixels and the ratio of control pixels to 
regular pixels may depend, inter alia, on the total number of pixels available on 
the imager pixel array, on the pixel scanning speed of the particular imager, on 

15 the number of control pixels which may be practically scanned in the time 
allocated for scanning, and on the duration of the illumination sampling period. 

An advantage of the embodiments using automatic illumination control 
methods in which some of the pixels of the CMOS imager pixel array (such as for 
example the example illustrated in Fig. 13) is that in contrast to light sensitive 

20 sensors which may be disposed externally to the surface of the imager (such as 
for example, the light sensing unit 67 of Fig. 3), the control pixels 160C actually 
sense the amount of light reaching the imager's surface since they are also 
imaging pixels disposed on the surface of the imager. This may be 
advantageous due to, inter alia, higher accuracy of light sensing, and may also 

25 eliminate the need for accurately disposing or the light sensing unit at an optimal 
place in the optical system, additionally, the control pixels may have signal to 
noise characteristics and temperature dependence properties similar to the other 
(non-control) pixels of the imager. 

Another advantage of using control pixels is that no external light sensing 

30 units are needed which may reduce the cost and simplify the assembly of the 
imaging device. 
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It is noted that, according to one embodiment, in a CMOS imager such as 
imager 160, the scanning of the control pixels 160C after the illumination 
sampling period 104 does not reset the pixels. Thus, the control pixels 160C 
continue to sense and integrate the light during the main illumination period 106, 
5 and are scanned after the time T M together with all the other regular pixels 160P 
of the imager 160. Thus, the acquired image includes the full pixel information 
since the control pixels 160C and the regular pixels 160P have been exposed to 
light for the same duration. The image quality or resolution is thus not 
significantly affected by the use of the control pixels 160C for controlling the 
10 illumination. 

It is also noted that while the arrangement of the control pixels 160C on 
the imager 160 is symmetrical with respect to the center of the imager, any other 
suitable arrangement of the pixels may be used. The number and the distribution 
of the control pixels on the imager 160 may be changed or adapted in 
15 accordance with the type of averaging used and/or for example, with the type of 
acquired images. 

Furthermore, the control pixels may be grouped into groups that may be 
processed separately to allow local illumination control in imagers using a 
plurality of separately controllable light sources. 

20 Reference is now made to Fig. 14, which is a schematic top view of the 

pixels of a CMOS imager illustrating an exemplary distribution of control pixel 
groups suitable for being used in local illumination control in an imaging device, 
in accordance with an embodiment of the present invention. 

The illustrated imager 170 is a 20X20 pixel array having 400 pixels. The 

25 control pixels are schematically represented by the hashed squares 170A, 170B, 
170C and 170C and the remaining imager pixels are schematically represented 
by the non-hashed squares 170P. Four groups of control pixels are illustrated on 
the imager 170. 

The first pixel group includes four control pixels 170A arranged within the 
30 top left quadrant of the surface of the imager 170. The second pixel group 
includes four control pixels 170B arranged within the top right quadrant of the 
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surface of the imager 170. The third pixel group includes four control pixels 170C 
arranged within the bottom right quadrant of the surface of the imager 170. The 
fourth pixel group includes four control pixels 170D arranged within the top left 
bottom quadrant of the surface of the imager 170. 

If the imager 1 70 is disposed in an autonomous imaging device having a 
plurality of light sources (such as, but not limited to the device 150 of Fig. 12), 
each of the four groups of control pixels 170A, 170B, 170C and 170D may be 
scanned and processed as disclosed hereinabove to provide data for locally 
controlling the illumination level reaching each of the respective four quadrants of 
the imager 170. The scanned data for each of the pixels within each of the four 
groups may be processed to compute a desired value of illumination intensity for 
the respective imager quadrant. The methods for controlling the illumination 
using separate local control loops may be similar to any of the methods disclosed 
hereinabove with respect to the device 150 of Fig. 12, except that in the device 
150 the light sensing units are units external to the imager and in the device 170, 
the control pixels used for sensing are imager pixels which are integral parts of 
the imager 170. 

The illumination control methods using control pixels may implemented 
using the closed-loop method of terminating the illumination when the integrated 
sensor signal reaches a threshold level as disclosed hereinabove or may be 
implemented by using an initial illumination intensity in a sampling illumination 
period and adapting or modifying the illumination intensity (if necessary) in 
accordance with a value computed or determined from the control pixel scanning 
as disclosed hereinabove. 

The signals or data of (representing the pixel charge) the pixel groups 
may be processed using averaging or weighted averaging methods to perform 
center biased or periphery biased averages or according to any other averaging 
or processing method known in the art. The results of the processing may be 
used as disclosed hereinabove to control the light sources (such as for example 
four light sources disposed within the imaging device in an arrangement similar to 
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the arrangement of the four light sources 163A, 163B, 163C, and 163D of Fig. 
12). 

It will be appreciated by those skilled in the art that the number of control 
pixels and the distribution of the control pixels on the surface of the imager may 

5 be varied, inter alia, in accordance with the desired type of averaging, the 
required number of local illumination control groups, the number and position of 
the light sources available in the imaging device, the computational power 
available to the processing unit available, the speed of the illumination control 
unit, and other design considerations. 

10 In accordance with another embodiment of the present invention, the 

control pixels 160C of Fig. 13 may be specially fabricated pixels, which are 
constructed differently than the regular pixels 160P. In accordance with this 
embodiment, the control pixels 160C may be fabricated as analog photodiodes 
with appropriate readout or sampling circuitry (not shown) as is known in the art. 

15 This implementation may use a specially fabricated custom CMOS imager in 
which the analog photodiodes serving as the control pixels 160C may be read 
simultaneously which may be advantageous since the readout or scanning time 
may be shorter than the time required to sequentially scan the same number of 
control pixels implemented in a regular CMOS pixel array having uniform pixel 

20 construction. 

It is noted that when analog photodiodes or other known types of 
dedicated sensors are integrated into the CMOS pixel array of the imaging 
device, the acquired image will have "missing" image pixels, since the area in 
which the analog photodiode is disposed is not scanned together with the regular 

25 CMOS array pixels. The image data will therefore have "missing pixels". If, 
however, a small number of analog photodiodes or other dedicated control pixels 
is included in the CMOS pixel array, the missing pixels may not cause a 
significant degradation of image quality. Additionally, such dedicated analog 
photodiodes or other control pixels may be distributed within the pixel array and 

30 may be sufficiently spaced apart from each other, so that image quality may be 
only slightly affected by the missing image pixels. 
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It is noted that while the illumination control methods are disclosed for use 
in an autonomous imaging device such as the device 10A of Fig. 1, these 
illumination control methods may also be used with or without adaptations in 
other in-vivo Imaging devices having an imager and an illumination unit, such as 

5 in endoscopes or catheter-like devices having imaging sensor arrays, or in 
devices for performing in-vivo imaging which are insertable through a working 
channel of an endoscope, or the like. 

Additionally, the illumination control methods disclosed herein may be 
used in still cameras and in video cameras which include a suitable imager, such 

10 as a CMOS imager, and which include or are operatively connected to an 
illumination source. 

Additionally, the use of control pixels implemented in a CMOS pixel array 
imagers, using selected regular pixels as control pixels or using specially 
fabricated control pixels such as the analog photodiodes or the like, may be 

15 applied for controlling the illumination of a flash unit or another illumination unit 
which may be integrated within the camera or may be external to the camera and 
operatively connected thereto. 

The advantages of using control pixels which are part of the CMOS imager 
of the camera may include, inter alia, simplicity of construction and operation, the 

20 ability to implement and use a plurality of controllably interchangeable averaging 
methods including weighted averaging methods and biasing methods, as 
disclosed in detail hereinabove, increased accuracy of illumination control. 

Additionally, in specialty cameras operating under conditions in which the 
light source included in the camera or operatively connected thereto is the only 

25 source of available illumination (such as, for example, in camera's operated at 
the bottom of the ocean, or in cameras which are designed to perform 
surveillance or monitoring in difficult to access areas which are normally dark), 
the use of illumination control methods disclosed hereinabove may allow to use 
shutterless cameras, which may advantageously increase the reliability of such 

30 devices, reduce their cost, and simplify their construction and operation. 
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It is noted that, while in the embodiments of the invention disclosed 
hereinabove the number and the arrangement of the control pixels are fixed, in 
accordance with another different embodiment of the present invention, the 
number and/or the geometrical configuration (arrangement) of the control pixels 
5 may be dynamically changed or controlled. For example, briefly turning to Fig. 2, 
the light sensing unit(s) 42 may represent one or more control pixels of a CMOS 
pixel array, and the illumination control unit 40, and/or the controller/processor 
unit 36 may be configured for changing the number of the control pixels used in 
an imaging acquisition cycle and/or for changing the arrangement of the control 

10 pixels on the pixel array of the imaging unit 32. 

Such changing of control pixel number and/or arrangement may be 
performed, in a non-limiting example, by changing number and/or arrangement of 
the pixels selected to be scanned as control pixels during the illumination 
sampling period 104 (Fig. 10A). Such a changing may allow the use of different 

15 averaging arrangements and methods and may allow changing of different 
biasing methods for different imaging cycles. 

Additionally, using dynamically controllable control pixel configuration, it 
may be possible to implement two or more illumination sampling periods within a 
single imaging cycle and to use a different pixel number or configuration for each 

20 of these two or more illumination sampling periods. 

It may also be possible to remotely control the number and/or 
configuration of the control pixels, by instructions which are wirelessly transmitted 
to the telemetry unit, for example, telemetry unit 34 (Fig. 2), in which case the 
telemetry unit may be configured as a transceiver unit capable of transmitting 

25 data and of receiving control data transmitted to it by an external transmitter unit 
(not shown in Fig. 2). 

It is noted that, while the embodiments disclosed hereinabove were based 
on modifying the light output from the illumination unit(s) (such as, for example 
the illumination unit 63 of Fig. 3) based on measurement and processing of the 

30 amount of light reaching the light sensing elements (such as, for example the 
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^ light sensing unit 67 of Fig. 3, or the light sensing units 42 of Fig. 2, or the control 

pixels 160C of Fig. 1 3), another approach may be used. 

According to some embodiments of the present invention, the gain of the 

5 pixel amplifiers of the imager (for example, imaging unit 32 of Fig. 2) and/or other 
parameters may be changed. The parameter change decisions may be based 
on, for example, the results of the measurement of the amount of light reaching 
the light sensing unit or units (such as, for example, the light sensing unit 42 of 
Fig. 2, the control pixels 160C of Fig. 13, or the like). In such an embodiment, 

10 the illumination unit of the imaging device(s) (such as, for example, the 
illumination unit 63A of Fig. 3, or the illumination unit 38 of Fig. 2 etc.) may be 
operated at a fixed or variable illumination intensity, for a fixed or variable time 
period. The light that reaches the light sensing unit(s) or the control pixels of the 
imaging device during a sampling period (e.g., a portion of the exposure period 

15 within a frame) may be measured at a sampling instance or point. A sampling 
instance or point may be a discrete point in time or may extend over a certain 
amount of time. Parameters such as the gain level or sensitivity of the imager 
pixel amplifiers, the light intensity, duration of illumination or other parameters 
may be changed individually or in any combination in relation to, for example, 

20 measurements of relative light saturation of selected pixels, to achieve proper or 
appropriate imaging. 

For example, if the amount of light reaching the light sensing unit(s) during 
an illumination sampling period, as measured at at least one selected sampling 
instance (period), is approximately sufficient to ensure proper image exposure 

25 (relative to, for example, an expected threshold for a determined number of 
pixels), the exposure may be stopped. In this case full exposure has already 
been achieved, and no further exposure is necessary. In this case, no change is 
the current image gain level should be required when transmitting the image. In 
addition, since the exposure was relatively short, there should be no problem with 

30 blurring, which may accompany images recorded with long light exposures. 
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In the case where the measurement at a sampling instance determines 
that too little saturation has been attained (relative to a threshold value) during an 
illumination sampling period, the exposure should be continued to enable 
sufficient lighting for an image. However, too much exposure may cause blurring, 
so the imager may be commanded to lower the saturation threshold so as to 
have a shorter exposure. In addition to lowering the saturation threshold, in order 
to compensate for the short exposure, the imager may be commanded to provide 
a higher gain level for the image transmission, to enable enough exposure in 
spite of the short exposure time. For example, if the saturation threshold was 
halved to shorten the exposure sufficiently, the gain level will correspondingly 
need to be doubled to enable adequate exposure. 

If too much light, possibly relative to an expected threshold, reaches the 
light sensing unit(s) during an illumination sampling period, the exposure may be 
stopped, and the pixel amplifier gain (or other parameters) may be decreased to 
prevent overexposure. Additional sampling periods may be instituted at chosen 
instances, to enable further fine-tuning of variables such as image gain and 
exposure time. 

In addition to changes in the analog gain, which may be based on 
continuously scanning the analog output of a selected number of pixels during 
the early phase of the exposure period, the exposure may be stopped at any 
stage where full (e.g., adequate) saturation has been reached. In this way, for 
example, full image exposure may be provided in many cases of low exposure, 
by, for example, adding gain levels to images. In addition, over exposure can be 
prevented in many cases where there is high exposure, by, for example stopping 
exposure when saturation is attained. These changes may result in increased 
image quality, energy saving and/or other benefits. 

Various embodiments may utilize various time, saturation, and voltage 
levels, and are not limited to the following defined levels. According to a particular 
application of the present embodiment, required time resolution, which defines 
the maximum read out time required to achieve saturation for all pre-selected 
pixels may be, for example, 0.25 s. Other values or ranges may be used. 
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According to some embodiments of the present invention, a total exposure 
time (e.g., an expected time required for adequate and/or correct exposure) may 
be defined (T1), within which an exposure measurement time (sampling time, 
such as T1/ 4 or other times which are a portion of T1) may be defined. The 
discrete time instances, where changes of reference levels may occur and gain 
decisions may be taken, may be determined by T1. This value may be used 
indirectly to set time intervals such as T1/ 2 and T1/ 4 , or other intervals, which may 
be sample time intervals for measuring pixel saturation. A maximum exposure 
time may also be defined (T M ). Typically, T1 and T M are both programmable. 
Typically, T M does not impact on the calculations, other than to set a maximal 
exposure time at which point exposure may be stopped, regardless of whether 
exposure saturation thresholds have been crossed. T1, on the other hand, may 
be used as the target exposure time. For example, T1 may refer to the expected 
exposure for adequate or complete saturation etc. At intervals TI/4 and T1/ 2 , for 
example, the current system or method according to some embodiments sets the 
saturation threshold levels expected to be crossed before T1 . 

Typically, the device 30 transmits image information in discrete portions. 
Each portion typically corresponds to an image or frame. Other transmission 
methods are possible. For example, the device 30 may capture an image once 
every half second, and, after capturing such an image, transmit the image to the 
receiving antenna. Other capture rates are possible. Typically, the image data 
recorded and transmitted is digital color image data, although in alternate 
embodiments other image formats (e.g., black and white image data) may be 
used. In one embodiment, each frame of image data includes 256 rows of 256 
pixels each, each pixel including data for color and brightness, according to 
known methods. For example, in each pixel, color may be represented by a 
mosaic of four sub-pixels, each sub-pixel corresponding to primaries such as red, 
green, or blue (where one primary is represented twice). The brightness of the 
overall pixel may be recorded by, for example, a one byte (i.e., 0-255) brightness 
value. Other data formats may be used. 
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According to one embodiment, a reliable exposure measurement may 
require inclusion of every n* (e.g., 4 th ) pixel (which may be, for example, every 
second RED pixel, since there are typically more red pixels according to one 
embodiment, in every m lines (e.g. 10 out of 256 lines, in a typical approximately 

5 66,000 pixel frame (e.g., 256 x 256 pixels)). This is equivalent to approximately 
640 pixels in a typical frame. In one embodiment a reliable exposure 
measurement may require approximately 1.5% (for example, 11 pixels out of 
640) of the selected pixels to be saturated in order to pass a saturation threshold, 
according to which gain decisions may be taken. Other frame sizes, 

10 percentages, and sample rates may be used, as appropriate. For example, 9, 
11 , 15, 24, and any other number of pixels can be used per frame or per sampled 
subset to determine a saturation threshold. Other individual pixels, e.g., non-red 
pixels, may be sampled, and sampling need not be based on color. 

According to one embodiment, exposure time may be determined in, for 

15 example, 8 steps, from 5ms to 40ms. Other numbers of steps and intervals may 
be used, and intervals need not be used - e.g., exposure time may be 
determined on a continual basis. Furthermore, T1 may be digitally 
programmable, for example, in 8 steps with a, for example, logarithmic scale 
from, for example, 1ms to 100ms. According to one embodiment, the accuracy of 

20 detection levels may be defined, for example, as less than 5%. Other accuracy 
levels may be used, as appropriate. 

The measurement of the exposure, according to one embodiment, may be 
performed on a subset of the pixels in the sensor array or imager. A 
determination as to whether a gain exposure change may be in order may be 

25 based on, for example, a percentage of the selected pixels that are saturated 
with light, relative to, for example, a saturation threshold for one or more pixels. 
The gain or other parameter setting decision may be based on one or more 
discrete time intervals within which the outputs from a nominal number of the 
selected number of pixels (e.g., 11 according to one embodiment) have reached 

30 a certain saturation level (e.g., reference level), or threshold. In this way, the 
exposure may continue until it is determined that the pixel output from the 
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nominal number of pixels has reached a new saturation level, at which time the 
gain (or other parameter) level may be changed. According to one embodiment, 
exposure may continue until, for example, full saturation or maximum exposure 
time (T m ) is reached. It should be noted that determination of full saturation may 
differ according to the various gain (or other parameter) levels. For example, 
expected saturation at gain 1 may be V1, and expected saturation at gain 4 may 
be V1/ 4 . The reference voltage (Vref), or threshold voltage, for determining 
whether gain and/or exposure need to be changed may be defined at any 
discreet time interval, relative to the proportion of time to T1. For example, Vref 
may be equal to Vfs/ 4 at time T1/ 4 , when the light reflection may initially be 
measured. Similarly, Vref may be equal to Vfs/ 2 at time T1/ 2 , when the light 
reflection may subsequently be measured. 

According to some embodiments of the present invention, an aggregate 
gray scale for the selected pixels (640 in the current example, etc.) may be 
measured at one or more intervals. The average may be compared to a 
saturation threshold, and gain decisions that are taken may be related to the 
average gray scale measurement and the relevant saturation threshold. 

According to some embodiments of the present invention, the signal 
saturation level may be defined as Voltage Saturation, or Vsat, which represents 
a low pixel voltage, and may be defined as the pixel saturation referred to 
ground. Pixel reset level may be defined as Vrst, which represents the highest 
pixel voltage. Finally, Vfs may be defined as the A/D full-scale voltage, which 
represents the actual saturation or voltage level at a determined interval. 
Accordingly, Vsat=Vrst-Vsat=Vfs. In other words, the pixel signal level may be 
defined as the difference between the pixel reset level and the instantaneous 
pixel voltage, and may be a positive voltage, increasing from 0, during exposure. 
This "delta-voltage" may be compared with the comparator reference voltage, 
such as, for example Vfs/ 4 , at T1/ 4 . 

Reference is now made to Fig. 15, which illustrates, according one 
embodiment of the present invention, gain setting decisions that may. be made, 
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during an exposure period, as a function of pixel output (light saturation) vs. time. 
As can be seen in Fig. 15, for example, three gain settings that may be used are 
gain 1, gain 2 and gain 4. The thicker lines 161, 163 and 165 represent the gain 
limits or thresholds. The settings of Fig. 15 are provided as an example only, 
and are not meant to be limiting. Other numbers of gain settings may be used. 

At an interval such as T1/ 4 , the saturation threshold (level) for selected 
pixels may be measured. The saturation threshold may be at, below, or above an 
expected threshold 161. In case "b", where the pixel output (average saturation of 
the selected pixels) is above the expected threshold 161, it is to be expected that 
full exposure will be completed within, for example, T1 . Therefore no increase in 
gain, or sensitivity, is necessary, and exposure continues until full saturation (Vfs) 
is reached, at which time exposure is stopped. 

In case u c", where the pixel output is below the expected threshold 161, 
but above a middle threshold 163, it is to be expected that exposure will not be 
completed within T1. Even though saturation may eventually be attained, the 
exposure will inevitably be longer than T1 , which may cause a blurring effect. 
Therefore the imager may be commanded to increase the gain level from gain 1 
to gain 2. Accordingly, the saturation threshold may be decreased by, for 
example, half, to Vfs/ 2 , which together with, for example, gain 2 amplification may 
provide full image exposure. The exposure may then continue until saturation 
level Vfs/ 2 is reached, at which time exposure may be stopped. Vfs/ 2 represents 
full saturation in this case since gain level 2 was applied. Other gain levels may 
be used. 

In case u d" where the pixel output is below the middle threshold 163, but 
above a lower threshold 165, it may be expected that exposure will not be 
completed within T1. Therefore exposure continues and, in addition, a more 
significant increase in gain level may be necessary. The imager may be 
commanded to increase the gain level to gain 4, for example, and exposure may 
subsequently continue until corresponding saturation level Vfs/ 4 is reached, at 
which time exposure may be stopped. 



P-4257-IL1 



48 



In case "a" where the pixel output is below the lower threshold 164, it may 
be expected that exposure will not be completed within T1 , or even within T M . 
Therefore an increase in gain level to gain 4, for example, may be necessary, 
and exposure may continue until T1. In this example, since full exposure has not 
been achieved even at T1, exposure may continue until T M , to increase the 
possibility of sufficient exposure. T M may be the maximum exposure time for all 
cases. 

As can been in the above example, and in relation to Fig. 15, full exposure 
has been achieved in 3 out of the 4 frames, and exposure time has likewise been 
reduced in 3 out of the four frames, possibly leading to significant increases in 
exposure clarity and decreases in usage of power resources. In alternate 
embodiments, other levels of alteration or improvement may result. 

Additional measurement instances may also be provided, such as, for 
example, T1/2 and T1/ 3 etc. The pixel exposures in the above scenarios may 
likewise be measured at this second interval, to establish whether further gain 
level changes are necessary. 

In one embodiment, a first scan may be utilized to search for "white spots", 
or "hot spots", which are problematic (poorly or non-functioning) image receivers 
that may not be counted in the group of saturated pixels. This first scan may 
therefore be designed to detect, define and discard the problematic or non- 
functional pixels from the selected pixel group. Such a defective/non-functioning 
scan need not be used. 

Following is an example of a non-limiting description of "pseudo-code", 

which may be used to implement an embodiment of the present invention. Other 

embodiments of the present invention may be implemented without coding, such 

as by using circuit design. Various embodiments of the present invention may be 

implemented using different code sequences and programming or logic design 

techniques: 

Vref=Vfs/ 4 
Gain=4 
Exposure='on' 
White_spots=Scan result 
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While Exposure='on' 

Pix_above_ref=Scan result %%%%For each scan 

|f(t>=Tm) 

Exposure-off 

Else %(t<Tm) , n 

If (Pix_above_ref-White_spots>='table_value ) 

If (Gain=4) 

lf(t<T1/ 4 ) 

Vref=Vfs; 

Gain=1; 
Else %(t>=T1/ 4 ) 
If (t<T1/ 2 ) 

Vref=Vfs/ 2 ; 
Gain=2 

Else %(t>=T1/ 2 ) 

exposure-off 

End %(t<T1/ 2 ) 
End %(t<T1/4) 
Else %(Gain !=4) 

Exposure='off 

End %(Gain=4) 
End % (Pix_above_ref-White_spots>='table_value ) 

End %(t<Tm) 
End %( While Exposure='on') 

It is noted that such automatic gain control may result, under certain 
conditions in changes in the signal to noise ratio (S/N) of the imager in some 
cases. For example, increasing the pixel amplifier gain in CMOS pixel array 
imagers may result in higher S/N ratios, while increasing the exposure time (Tm) 
may increase the image "blur". 

According to some embodiments of the present invention, the above 
described principles and related Fig. 15 may likewise be used to describe 
implementations of the present invention for other parameters such as 
illumination intensity and duty cycle etc., or in combination with such other 
parameters. For example, a method may be followed for determining light 
saturation in relation to light intensity and duty cycle et, according to threshold 
values, at selected instances. These calculations of saturation level may 
determine whether such parameters are at, below or above a given threshold. 



P-4257-IL1 



50 



Such a determination may enable decision making such as to change light 
illumination, duty cycle etc. to reflect the exposure needs of the relevant frames. 

For example, the controller or any other element may measure light 
saturation levels in one or more light measuring elements, and in response to 
resulting measurements, may simultaneously at least one of control illumination 
duration, illumination intensity and/or image gain level. According to one 
embodiment of. the present invention, illumination (exposure) may be increased 
eight-fold, for example, using the following or other possibilities: 

i. duration x 2, intensity x 2, gain x 2 

ii. duration x 8, intensity x 1 , gain x 1 

iii. duration x 1 , intensity x 8, gain x 1 

iv. duration x 1 , intensity x 1 , gain x 8 

v. duration x 1 .5, intensity x 1 .5, gain x 3.56 etc. 

Any other combinations of parameters that may be required to implement 
the above or alternate illumination targets may be utilized. Additional, any other 
suitable parameters may be factored in to the above described embodiments, 
individually or in any combination, to enable an in-vivo imaging device to provide 
more accurate exposure. 

According to some embodiments of the present invention, a method is 
provided for determining the location or position of an in vivo device, such as an 
in vivo imaging capsule. For example, a method is provided for determining when 
an in vivo device enters into a body or enters into a particular area of the body, 
etc. This determination may be used for decision making, such as, for example, a 
decision whether an in vivo capsule should enter or exit an operational mode 
such as "fast mode", "slow mode", "standard mode" etc. A fast mode, for 
example, may enable the imaging device to attain an increased frame rate, which 
may be particularly useful for enabling rapid imaging of the esophagus after 
swallowing an imaging capsule. Such rapid imaging is not required, however, 
when the device is in, for example, the small intestine, therefore the device may 
be programmed to switch to a "standard mode" after a time period following the 
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internalization of the device. Other operational mode changes may be effected. 
Thus, for example, the imaging device may send compressed data in "fast mode" 
when traveling down the esophagus, and then operate in regular uncompressed 
mode at a lower frame rate thereafter, when such a fast frame rate is not 
5 required. 

In one embodiment of the invention, this may be accomplished by setting 
a mode, such as a fast mode, to end when a significant change has been 
determined in the environment surrounding the device. This may be 
accomplished by providing an environmental monitoring tool, such as a pH 
10 indicator, temperature gauge or light level indicator etc. in, on or outside of the 
imaging device to measure or otherwise determine environmental data. The 
monitoring or measurement tool may compare the measured data with previously 
measured environmental data to determine environmental changes. When, for 
example, the environment of the capsule has fallen below a certain pH level, this 
15 change in pH level may indicate that the esophagus has been traversed and that 
the imaging device is in the stomach. Various environments or environmental 
changes may be determined, depending on the measurement tools being used, 
such as outside the body, inside the body, in the mouth, in the throat, in the 
esophagus, in the stomach, in the small intestine etc. 
20 In other embodiments, a mode, such as a fast mode, may be set to end a 

fixed amount of time, e.g. five minutes, after a change is detected. A change 
may be, for example, the capsule entering a dark environment such as the 
mouth. For example, a controller may configure a light source to provide a "dark 
frame" at determined frame intervals, such as, for example, at 1 frame out of 
25 every 256. During a dark frame, LEDs or other illumination sources may not be lit 
or may be lit for a brief instant, substantially inadequate to provide viable 
exposure for an image. For example, an in vivo imaging device may require a 
25ms exposure at a fixed light intensity to adequately light an internal lumen, yet 
purposefully provides an inadequate exposure of, for example, 5ms. The device 
30 may periodically process the "dark" frame, which may be analyzed to determine 
the presence of ambient light in the environment of the device. If the ambient 
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light is above a threshold level, indicating that there is a substantial amount of 
surrounding light and that a non-substantial amount of additional light is required 
for the image to attain saturation, it may be assumed that the capsule has not yet 
entered the body and that the fast mode should continue. If the ambient light 
during the dark frame is below a threshold level, indicating that the image 
requires a substantially significant amount of additional light to attain saturation, it 
may be assumed that the capsule has entered a darker environment, such as the 
body. In this case it may be assumed that the fast mode will no longer be 
necessary after a predetermined period of time, e.g., five minutes, by which time 
it may be assumed that the capsule has passed through the esophagus. 

According to some embodiments, the exposure of the dark frame may be 
measured in relation to a light saturation threshold for the dark frames, to 
determine whether and/or by how much a change in an imager gain level is 
required. If the dark frame requires a substantially non-maximal gain factor, 
15 indicating that the image has a relatively adequate amount of light and only a 
relatively small gain level may be required to reach full exposure, the device may 
be defined as being outside a body. When the dark frame requires a large or 
maximal gain factor, indicating that a substantial gain is required for possibly 
reaching full saturation, the device may be defined as being inside a body. 
20 Fig. 16A depicts a series of steps of a method for determine a necessary 

image gain level during an exposure period, according to an embodiment of the 
present invention. In alternate embodiments, other steps, and other series of 

steps, maybe used. 

In step 500, a device, such as an in-vivo imaging device, turns on a light 

25 source. 

In step 510, which may be a short sampling period, the device records 
(and possibly integrates) the amount of light received to at least one light 
measuring element. This may be, for example, to a sensor on the device, or 
possibly to an external sensor. 
30 In step 520, the device determines the amount of light recorded. 
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In step 530, if the amount of light recorded, for example, by a portion of 
the frame's pixels is less than a certain pre-determined value (saturation 
threshold). 

In step 540, the image gain level may be increased, and the device may 
5 continue exposure (or other parameters, such as light level etc.) until saturation is 
attained 560. In this case, step 520 may be repeated at a subsequent time 
interval. 

In step 550, where the amount of light recorded is more than a certain 
value (threshold), the image gain level may be decreased. Step 520 may be 
10 repeated at a subsequent time. At full saturation exposure may be stopped 560. 

If the amount of light recorded is substantially equivalent to a determined 
saturation threshold (close in value to such a threshold such that the amount of 
light exposed can be assumed to be sufficient), a current gain level or light level 
etc., may be maintained and the exposure may be stopped when full saturation 
15 occurs, or until a maximum exposure time (T M ) is reached, whichever is first to 
occur. The process may then be repeated 570 for subsequent frames. 

In step 570, the above process is repeated from step 500, as, the device 
may operate across a series of imaging periods. However, the method need not 
be repeated. 

20 According to one embodiment steps 500 to 520 may be complemented or 

replaced by a step wherein data from an environmental monitoring tool is 
analyzed, to determine if one or more particular data measurements, such as pH 
level, temperature level etc., are above, below or equal to a threshold for the 
particular measurement(s), or to one or more previous measurements. The 

25 results of such a comparison may be used to determine whether an 
environmental change has occurred, and whether an appropriate gain level 
change is in order. For example, an in vivo capsule may be adapted to carry 
multiple measurement tools for measuring different aspects in the environment, 
including a light level indicator and a pH indicator. In frame A the capsule may 

30 have measured levels i and ii using the two indicators listed above. In a second 
frame B it may be determined, for example, that both parameters i and ii have 
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changed substantially from their measurements in frame 1. In the case where the 
light level indicator reflects a darkening of the environment, and the pH indicator 
indicate a higher acidity, it may be determined that the capsule has both entered 
the body (a darker environment) and entered the stomach (increased acidity). 
5 Fig. 16B depicts a series of steps of a method for determining when an in 

vivo device has entered an area with different illumination, according to an 
embodiment of the present invention. In alternate embodiments, other steps, and 
other series of steps, may be used. 

In step 600, a device, such as an in-vivo imaging device, turns on 
10 (operates) a light source. 

In step 610, the device records (and possibly integrates) the amount of 
light received to a light measurement element. This may be, for example, part of 
the imager, a sensor on the device, or possibly to an external sensor. 

In step 620, the device determines the amount of light recorded. 
15 Furthermore, the device may calculate this amount of light recorded in relation to 
a saturation threshold or any other threshold, to determine a possible location of 
the device based on the amount of light recorded. For example, if the light 
recorded in a first frame is above a saturation threshold of, for example, 15 pixels 
out of the frame, this indicates that saturation has easily been attained, and the 
20 device is assumed to be outside the body (in a light environment). If the light 
recorded in a second frame is below the same saturation threshold of, for 
example, 15 pixels out of the frame, this indicates that saturation has not been 
attained, and the device is assumed to be inside the body (in a dark 
environment). 

25 In step 630, a decision may be taken to change operation mode of the 

device, depending on the amount of light recorded relative to a threshold value. 

In step 640, for example, if the amount of light recorded is less than a 
certain value (threshold), indicating that the device is located in a darker area, the 
device may change the mode of operation 640 to reflect this darker environment. 

30 For example, the device may be configured to start operating in a fast-mode for a 
period .of 10 minutes after entering the body, to enable fast imaging of the 
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esophagus area. After determining that the device has entered the body, the 
timer may be initiated, so that after 10 minutes the device will change into a 
slower mode for the remainder of the procedure. 

In step 650, for example, if the amount of light recorded is more than a 
certain value (threshold), indicating that the device is located in a lighter area, the 
device may change the mode of operation 650 to reflect this lighter environment. 

Fig. 16C depicts a series of steps of a method for determining an in vivo 
device's location, according to an embodiment of the present invention. In 
alternate embodiments, other steps, and other series of steps, may be used. 

In step 700, a device, such as an in-vivo imaging device, operates at least 
one environmental measuring device, such as, for example, a pH level sensor 
and a light detection meter. 

In step 710, the device records a measurement, such as pH level for 
example, received to the measurement device. This measurement device may 
be, for example, a sensor on or in the device and/or an external sensor. 

In step 720, the device determines the quantity and/or quality of the 
measurement recorded. 

In step 730, the device may determine a location in a body based on the 
measurement data recorded, as compared with a threshold value or previous 
measurements etc. For example, if the pH level in a first frame is above a 
saturation threshold of, for example 7 on the pH scale, this indicates that the 
device is in a non-acidic environment, and may be assumed to be in the throat 
area (in an acidic-neutral environment). If the pH level recorded in a second 
frame is below the same threshold of, for example, 7 on the pH scale, this 
indicates that the device is in a more acidic environment, and may be assumed to 
be in the stomach or intestine area, depending on the pH level recorded. 

In step 740, a decision may be taken to change operation mode of the 
device, depending on the measurement data recorded relative to a threshold or 
alternative value. 

In step 750, for example, if the amount of measurement data quantity 
and/or quality is more or less than a certain value (threshold or other value), 
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indicating (or verifying) that the device is located in a different area, the device 
may change the mode of operation to reflect this new environment. 

The results of the above processes may be used to determine whether 
environmental conditions have substantially changed, based on results from 
5 various optional monitoring and/or measuring tools. The change required to be 
defined as "substantial" or "significant" may be determined for each case or by 
manufacture. 

Typically, the various embodiments discussed herein may be implemented 
in a device such as device 30 (Fig. 2); however, such embodiments may be 

10 implemented in a variety of imaging or sensing devices, varying in structure. The 
various functions and processes described above, including but not limited to 
processing, monitoring, measuring, analyzing, ^ defining, tracking, comparing, 
computing, commanding, stopping exposure, increasing gain, decreasing gain, 
increasing exposure, decreasing exposure, changing mode etc. may be executed 

15 by, for example, a processor unit (e.g., 36 in Fig. 2). These functions or 
processes may additionally and/or alternatively be implemented by the processor 
unit 36 alone, by alternative units, such as illumination control unit 40, telemetry 
unit 34, light sensing units 42, imaging unit 32 etc., or any combination of units. 
The methods and processes described may also be embodied in other sensing 

20 devices having other structures and other components. Alternately, part or all of 
the analysis or control involved in the various methods presented may be 
performed by an external workstation or processing unit. 

It will be appreciated by those skilled in the art that while the invention has 
been described with respect to a limited number of embodiments, many 

25 variations, modifications, combinations and other applications of the invention 
may be made which are within the scope and spirit of the invention. 
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CLAIMS 

1 . An in vivo imaging device comprising: 

at least one light source; 
at least one imager; and 

at least one controller, wherein the controller is configured to, 
during an imaging period, operate the light source, record the amount of 
light reflected to the imaging device, and control the image gain level of 
the imager. 

2. The device of claim 1 comprising at least one light measuring 
element. 

3. The device according to claim 2 wherein said at least one light 
measuring element includes at least a portion of a set of pixels. 

4. The device according to claim 2 wherein the at least one light 
measuring element includes at least one photo detector. 

5. The device according to claim 2 wherein said at least one light 
measuring element is integrated into said imager. 

6. The imaging device of claim 1, wherein said controller is adapted to 
control at least one parameter selected from the group consisting of 
image gain level, illumination duration and illumination intensity. 

7. The imaging device of claim 1, wherein said controller is adapted to 
control at least one parameter selected from the group consisting of 
illumination duration and illumination intensity for at least each one 
a plurality of light sources. 

8. The imaging device of claim 7, wherein individual control of said 
parameter(s) is enabled by at least one control pixel for at least 
each one a plurality of light sources. 

9. The imaging device of claim 8, wherein control pixel(s) is adapted 
to enable a fast read-out procedure. 

10. The imaging device of claim 1 wherein when the amount of light 
recorded at a sampling point is below a determined saturation 
threshold, said controller is adapted to implement at least one of 
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the functions selected from the group consisting of increasing 
image gain level, decreasing illumination duration, and increasing 
illumination intensity. 

1 1 . The device of claim 1 , comprising a transmitter. 

12. The device of claim 1 , comprising at least one measurement tool. 

13. The device of claim 12, wherein said at least one measurement tool 
is adapted to measure at least one environmental parameter 
selected from the group consisting of light level, and pH level. 

14. The device of claim 12, wherein said measurement tool is in a 
location selected from the group consisting of internally to the 
device, on the surface of the device and externally to the device. 

15. The device of claim 1 , wherein the device is a swallowable capsule. 

16. An in vivo imaging device comprising: 

at least one light source; 

at least one light measuring element; 

at least one imager; and 

at least one controller, wherein the controller is configured to, 
during an imaging period, operate the light source, record the amount of 
light reflected to the light measuring element, and control the image gain 
level of the imager. 

17. An in vivo imaging device comprising: 

at least one lighting means for providing lighting for the device; 

at least one imager means , for recording images for the device; 

and 

at least one controller means for controlling the image gain level of 
the imager. 

18. A method for operating an in vivo imaging device including at least 
one light source, the method comprising: 

during an imaging period, operating at least one light source; 
at a sampling instance, recording the amount of light reflected to at 
(east one light measuring element; and 
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comparing an amount of light recorded at at least one sampling 
instance within said imaging period to a determined light saturation 
threshold; and 

controlling the imaging device's gain factor in relation to the 
difference between said amount of light recorded and said light saturation 
threshold. 

19. The method of claim 18, comprising controlling the operation of the 
light source in relation to the difference between said amount of 
light recorded and said light saturation threshold. 

20. The method of claim 18, comprising controlling operations of each 
of at least one of the light sources from a plurality of light sources. 

21. The method of claim 18, comprising at least one function selected 
from the group consisting of controlling the intensity of said light 
source and controlling duration of light source operation in relation 
to the difference between said amount of light recorded and said 
light saturation threshold. 

22. The method of claim 18, wherein when an amount of light recorded 
is above a determined light saturation threshold, ceasing said 
operation of said light source. 

23. The method of claim 18, wherein when said amount of light 
recorded is above said determined light saturation threshold, 
decreasing said gain factor. 

24. The method of claim 18, wherein when said amount of light 
recorded is below said determined light saturation threshold, 
increasing said gain factor. 

25. The method of claim 18, wherein if said light received is 
substantially similar to said light saturation threshold, continuing 
exposure at a constant gain factor until full saturation is attained. 

26. The method of claim 18, comprising, at at least a second sampling 
instance: 
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comparing an amount of light recorded to a determined light 
saturation threshold; and 

controlling the imaging device's gain factor in relation to the 
difference between said amount of light recorded and said light saturation 
threshold at said second selected interval. 

27. The method of claim 26, comprising controlling the operation of 
said light source in relation to the difference between said amount 
of light recorded and said light saturation threshold. 

28. The method of claim 26, comprising controlling the operation of 
intensity of said light source in relation to the difference between 
said amount of light recorded and said light saturation threshold. 

29. The method of claim 18, wherein said light measuring element 
includes at least a portion of a set of pixels disposed in an imager 
disposed within the in-vivo device. 

30. The method of claim 18, wherein said light measuring element 
includes a photo detector, and wherein said device includes an 
imager. 

31. The method of claim 18, wherein said recording the amount of light 
reflected is recorded from a portion of pixels of a frame. 

32. The method of claim 26, wherein said light saturation threshold is 
defined when a selected number of pixels from said portion of 
pixels are saturated. 

33. The method of claim 32, wherein substantially half of said portion 
of pixels are red pixels. 

34. The method of claim 32, comprising calculating a gain factor based 
on how many of said selected number of pixels are saturated at at 
least one sampling instance. 

35. The method of claim 34, comprising altering said operation of the 
light source relative to said calculated gain factor. 

36. The method of claim 35, wherein said altering of the light source 
includes at least one function selected from the group consisting of 
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altering illumination duration and altering illumination intensity for at 
least each one of said light sources. 

37. The method of claim 23, wherein said decreases in said gain factor 
decrease a signal to noise disturbance factor. 

38. The method of claim 24, wherein said increases in gain factor 
increase a signal to noise disturbance factor. 

39. The method of claim 18, comprising detecting non-functional pixels 
in said light measuring element, and marking said non-functional 
pixels as non-usable. 

40. The method of claim 18, wherein the device is a swallowable 
capsule. 

41. A method for operating an in vivo imaging device including at least 
one light source, the method comprising: 

during an imaging period,. operating at least one light source; 

at a sampling instance, recording the amount of light reflected to at 
least one light measuring element; and 

comparing an amount of light recorded at at least one sampling 
instance within said imaging period to a determined light saturation 
threshold; and 

controlling at least one function selected from the group consisting 
of controlling the intensity of said light source, controlling duration of light 
source operation, and controlling the imaging device's gain factor in 
relation to the difference between said amount of light recorded and said 
light saturation threshold. 

42. An in vivo imaging device comprising: 

at least one light source; 
at least one imager; and 

at least one controller, wherein the controller is configured to detect 
problematic pixels in said imager, and define said problematic pixels as 
non-functional. 
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43. The device of claim 42, wherein said imager is configured to 
provide an exposure that is of a shorter duration than typically 
required for saturation of a functional pixel. 

44. The device of claim 42, wherein said controller detects at least one 
pixel that reflects a saturation level above a threshold saturation 
level. 

45. An in vivo imaging device comprising: 

at least one light source; 

at least one imager configured to provide an exposure that is of a 
shorter duration than typically required for saturation of a functional pixel; 
and 

a controller, wherein the controller is configured to detect 
problematic pixels in said imager, based on said short exposure, and 
define said problematic pixels as non-functional. 

46. An in vivo imaging device comprising: 

at least one lighting element for providing lighting for the device; 

at least one imager element, for recording images for the device; 

and 

at least one controller element for detecting problematic pixels in 
the imager, and defining the problematic pixels as non-functional. 

47. A method for detecting problematic pixels in an imaging device, the 
method comprising: 

initiating an exposure that is of a shorter duration than required 
for typical saturation of at least one functional pixel; 

detecting at least one pixel that reflects a saturation level above a 
threshold saturation level; and 

defining said at least one pixel that reflects a saturation level above 
said threshold saturation level as non-functional. 

48. The method of claim 47, comprising mapping said non-functional 
pixels. 
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49. The method of claim 48, comprising excluding said non-functional 
pixels from future saturation level determination processes. 

50. The method of claim 47, wherein said imaging device is included 
within a swallowable capsule. 

51 . A method for detecting problematic pixels in an imaging device, the 
method comprising: 

initiating an exposure that is of a shorter duration than required for 
saturation of a functional pixel; 

detecting at least one pixel that reflects a saturation level above a 
threshold saturation level; 

defining said at least one pixel that reflects a saturation level above 
said threshold saturation level as non-functional; and 

excluding said non-functional pixels from future saturation 
level determination processes. 

52. An in vivo imaging device comprising: 

at least one light source; 
at least one imager; and 

at least one controller, wherein the controller is adapted to operate 
the light source to provide dark frames at determined frame intervals and 
record the amount of light reflected to the imager during said dark frame. 

53. The imaging device of claim 52, wherein said dark frame includes a 
frame wherein a substantially inadequate amount of light is 
exposed by said light source. 

54. The imaging device of claim 52, wherein said controller is capable 
of determining the location of the device according to said amount 
of light reflected to the imager during said dark frame. 

55. The imaging device of claim 54, wherein said location of the device 
is determined to be at least one environment selected from the 
group consisting of outside the body, inside the body, in the mouth, 
in the throat, in the esophagus, and in the stomach. 
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56. The imaging device of claim 52, wherein the controller is configured 
to change the device operation mode in relation to said amount of 
light. 

57. An in vivo imaging device comprising: 

at least one light source; 
at least one imager; and 

at. least one controller, wherein the controller is adapted to operate 
the light source to provide dark frames at determined frame intervals, 
record the amount of light reflected to the imager during said dark frame, 
and change the imaging device operational mode in relation to said 
amount of light recorded. 

58. An in vivo imaging device comprising: 

at least one lighting means for providing lighting for the device; 

at least one imager means , for recording images for the device; 

and 

at least one controller means for operating the lighting means to 
provide dark frames at determined frame intervals and recording the 
amount of light reflected to the imager means during said dark frame, 
further determining the location of the device according to said amount of 
light reflected to the imager means during said dark frame. 

59. A method for determining when an in vivo device enters into a 
body, the method comprising: 

configuring a dark frame at a selected frame interval in a device 
imager unit; 

at every said dark frame, providing a substantially inadequate 
exposure by at least one light source; 

measuring an exposure of a reflected image for said dark frame as 
a function of a light saturation threshold; and 

when said dark frame requires a substantially low amount of light to 
be saturated, defining the device as being outside a body. 
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60. The method of claim 59, wherein when said dark frame requires a 
substantially significant amount of light, defining the device as 
being inside a body. 

61 . The method of claim 60, comprising changing the operating mode 
of the device at a determined time interval after the device is 
defined as being inside a body. 

62. The method of claim 59, wherein said determining a required 
amount of light to be saturated relates to a required imager gain 
level for said dark frame. 

63. The method of claim 60, comprising changing an operation mode of 
the device, after the device is defined as being inside a body. 

64. A method for determining when an in vivo device enters into a 
body, the method comprising: 

configuring a dark frame at a selected frame interval in a device 
imager unit; 

at every said dark frame, providing a substantially inadequate 
exposure by at least one light source; 

measuring an exposure of a reflected image for said dark frame as 
a function of a light saturation threshold; 

when said dark frame requires a substantially high amount of light 
to be saturated, defining the device as being inside a body; and 

changing the operating mode of the device at a determined time 
interval after the device is defined as being inside a body. 

65. An in vivo imaging device comprising: 

at least one light source; 
at least one imager; 

at least one environment measuring tool; and 

at least one controller, capable of operating the light source, 
imager, and monitoring tool, such that when the measuring tool measures 
at least one environmental parameter the controller is capable of defining 
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the location of the device based on said at least one environmental 
parameter. 

66. The imaging device of claim 65, wherein said location of the device 
is at least one environment selected from the group consisting of 
outside the body, inside the body, in the mouth, in the throat, in the 
esophagus, in the stomach, and in the Gl tract. 

67. The imaging device of claim 65, wherein the controller is configured 
to change the device operation mode in relation to said device 
location. 

68. The imaging device of claim 65, wherein the environment 
monitoring tool operates in at least one location selected from the 
group consisting of on the device, in the device and outside the 
device. 

69. An in vivo imaging device comprising: 

at least one light source; 
at least one imager; 

at least one environment measuring tool; and 

a controller, capable of defining the location of the device based on 
at least one environmental parameter measured by said measuring tool, 
and changing the operating mode of the device according to said defined 
location. 

70. An in vivo imaging device comprising: 

at least one lighting means for providing lighting for the device; 

at least one imager means , for recording images for the device; 

an environment measuring means for measuring at least one 
environmental parameter; and 

at least one controller means for operating the lighting means , 
imager means , and measuring means . 

71. A method for determining a location of an in-vivo device, the 
method comprising: 
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measuring at least one environment parameter in an 
environment surrounding the device, using at least one measuring 
tool; 

determining a change in said at least one environment 
parameter; and 

based on said environmental change, determining that the 
device is in a new location. 

72. The method of claim 71, wherein monitoring tool measures at least 
one characteristic of the environment, and compares at least one 
said characteristic with a previous measurement of said 
characteristic. 

73. The method of claim 71, wherein said tool is at least one tool 
selected from the group consisting of pH monitor, temperature 
monitor, and light level monitor. 

74. The method of claim 71, further comprising changing the device 
operating mode after a new location is defined. 

75. A method for determining a location of an in-vivo device, the. 
method comprising: 

measuring at least one environment parameter in an 
environment surrounding the device, using at least one measuring 
tool; 

determining a change in said at least one environment 
parameter; 

based on said environmental change, determining that the 
device is in a new location; and 

changing the operating mode of the device at a determined 
time interval after the device is defined as being in a new location. 

76. A method for changing the operation mode of an in vivo device, the 
method comprising: 

measuring at least one environment parameter in at least 
one environment surrounding the device; 
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when an environmental change is determined, changing 
the operating mode of the device. 

77. The method of claim 76, wherein said environmental change is at 
least one change selected from the group consisting of temperature 
change, pH level change and light level change. 

78. The method of claim 76, wherein said environment monitoring is 
enabled by at least one tool selected from the group consisting of 
pH monitor, temperature monitor, and light level monitor. 

79. The method of claim 76, wherein a controller determines when a 
significant environmental change is determined. 

80. A method for changing the operation mode of an in vivo device, the 
method comprising: 

measuring at least one environment parameter in at least 
one environment surrounding the device, using at least one 
environment measuring tool; and 

when an environmental change is determined, changing 
the operating mode of the device. 
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81. The device according to any of claims 1-17,42-46,52-58,65-70 substantially as described 
hereinabove. 

82. The device according to any of claims 1-17,42-46,52-58,65-70 substantially as illustrated 
in any of the drawings. 

83. The method according to any of claims 18-41,47-51,59-64,71-80 substantially as 
described hereinabove. 

84. The method according to any of claims 18-41,47-51,59-64,71-80 substantially as 
illustrated in any of the drawings. 
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